Jul 02 23:01:18.126009 ip-10-0-132-1 systemd[1]: Starting Kubernetes Kubelet... Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.580050 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584901 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584915 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584920 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584923 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584926 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584929 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584932 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:18.861798 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584935 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584940 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584943 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584946 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584949 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584952 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584955 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584958 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584960 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584964 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584967 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584970 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584973 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584975 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584978 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584980 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584983 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584986 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584988 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:18.871770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584991 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:18.657717 ip-10-0-132-1 systemd[1]: Started Kubernetes Kubelet. Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.584998 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585002 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585005 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585008 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585010 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585013 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585016 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585018 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585021 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585023 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585026 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585029 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585031 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585034 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585036 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585039 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585041 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585044 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585046 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:18.875826 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585048 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585051 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585053 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585056 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585058 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585061 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585063 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585066 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585069 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585072 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585074 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585079 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585082 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585085 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585089 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585092 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585096 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585099 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585102 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:18.878704 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585105 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585107 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585110 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585112 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585115 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585119 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585122 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585124 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585127 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585129 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585132 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585135 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585137 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585140 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585142 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585145 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585148 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585150 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585153 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585156 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:18.882449 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585158 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585161 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585163 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585166 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585169 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585172 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585174 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585176 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585179 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585182 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585185 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585188 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585190 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585193 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585926 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585934 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585938 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585941 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585944 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585947 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:18.884934 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585950 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585955 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585958 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585961 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585964 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585968 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585970 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585974 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585978 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585981 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585984 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585986 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585989 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585992 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585995 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.585998 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586000 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586004 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586007 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:18.887003 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586009 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586012 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586015 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586017 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586020 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586023 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586026 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586028 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586031 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586033 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586036 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586038 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586041 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586044 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586047 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586049 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586052 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586054 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586057 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:18.889607 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586060 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586063 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586065 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586068 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586070 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586074 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586076 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586079 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586082 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586084 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586087 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586090 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586092 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586095 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586098 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586101 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586103 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586106 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586109 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586111 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:18.891673 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586114 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586116 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586119 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586121 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586125 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586127 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586130 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586132 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586135 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586138 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586141 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586143 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586146 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586149 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586152 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586154 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586157 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586160 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586162 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586165 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:18.894136 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586167 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586170 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586172 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586175 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586178 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586180 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586184 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586188 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586190 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586193 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586196 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586198 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586201 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586203 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586206 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586557 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586561 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586564 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586567 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586570 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:18.896067 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586573 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586575 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586578 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586581 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586583 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586586 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586589 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586592 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586597 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586600 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586603 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586606 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586609 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586611 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586614 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586617 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586621 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586625 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586628 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:18.898697 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586631 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586635 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586638 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586641 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586644 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586647 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586650 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586652 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586655 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586657 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586660 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586680 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586682 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586685 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586688 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586690 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586693 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586695 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586699 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:18.900764 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586702 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586705 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586710 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586713 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586715 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586718 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586722 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586725 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586728 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586731 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586734 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586737 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586740 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586743 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586746 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586748 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586751 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586754 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586757 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:18.903104 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586760 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586763 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586765 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586768 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586770 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586773 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586775 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586778 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586780 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586783 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586785 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586788 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586790 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586792 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586796 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586800 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586802 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586804 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586807 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586810 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:18.905041 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586812 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586814 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586817 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586820 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586822 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586824 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586827 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586830 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586832 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586834 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586837 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586839 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586842 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586844 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586847 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586849 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.586852 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586923 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586930 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586938 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586944 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 23:01:18.907560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586950 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586953 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586957 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586962 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586965 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586967 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586976 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586979 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586983 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586987 2564 flags.go:64] FLAG: --cgroup-root="" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586990 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586993 2564 flags.go:64] FLAG: --client-ca-file="" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586996 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.586999 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587003 2564 flags.go:64] FLAG: --cluster-domain="" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587007 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587010 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587013 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587016 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587020 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587023 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587025 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587029 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587032 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 02 23:01:18.909640 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587035 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587038 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587041 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587044 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587048 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587051 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587054 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587057 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587060 2564 flags.go:64] FLAG: --enable-server="true" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587063 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587067 2564 flags.go:64] FLAG: --event-burst="100" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587070 2564 flags.go:64] FLAG: --event-qps="50" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587072 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587075 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587080 2564 flags.go:64] FLAG: --eviction-hard="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587084 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587087 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587091 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587095 2564 flags.go:64] FLAG: --eviction-soft="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587097 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587100 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587103 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587106 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587109 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587112 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 23:01:18.912154 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587115 2564 flags.go:64] FLAG: --feature-gates="" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587118 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587121 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587125 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587128 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587130 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587133 2564 flags.go:64] FLAG: --help="false" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587136 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-1.ec2.internal" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587140 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587143 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587145 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587149 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587152 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587155 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587158 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587160 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587163 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587166 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587169 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587172 2564 flags.go:64] FLAG: --kube-reserved="" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587174 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587178 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587181 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587184 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 23:01:18.914457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587188 2564 flags.go:64] FLAG: --lock-file="" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587191 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587194 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587197 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587202 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587205 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587207 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587210 2564 flags.go:64] FLAG: --logging-format="text" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587213 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587216 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587219 2564 flags.go:64] FLAG: --manifest-url="" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587222 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587226 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587229 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587233 2564 flags.go:64] FLAG: --max-pods="110" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587236 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587239 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587243 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587245 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587248 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587260 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587264 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587274 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587278 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587282 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 23:01:18.917325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587286 2564 flags.go:64] FLAG: --pod-cidr="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587291 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587298 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587301 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587306 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587310 2564 flags.go:64] FLAG: --port="10250" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587315 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587320 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0579f0491bc29c603" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587327 2564 flags.go:64] FLAG: --qos-reserved="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587330 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587335 2564 flags.go:64] FLAG: --register-node="true" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587339 2564 flags.go:64] FLAG: --register-with-taints="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587344 2564 flags.go:64] FLAG: --registry-burst="10" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587348 2564 flags.go:64] FLAG: --registry-qps="5" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587353 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587356 2564 flags.go:64] FLAG: --reserved-memory="" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587362 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587366 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587370 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587375 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587379 2564 flags.go:64] FLAG: --runonce="false" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587383 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587387 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587392 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587396 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 23:01:18.922262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587400 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587404 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587409 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587413 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587417 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587421 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587425 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587429 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587434 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587439 2564 flags.go:64] FLAG: --system-cgroups="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587443 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587453 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587457 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587461 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587468 2564 flags.go:64] FLAG: --tls-min-version="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587475 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587479 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587484 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587488 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587492 2564 flags.go:64] FLAG: --v="2" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587497 2564 flags.go:64] FLAG: --version="false" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587503 2564 flags.go:64] FLAG: --vmodule="" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587509 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.587513 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587684 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:18.923268 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587690 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587694 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587698 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587702 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587706 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587710 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587713 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587717 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587721 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587724 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587728 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587732 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587735 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587739 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587743 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587746 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587750 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587753 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587760 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:18.925364 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587764 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587768 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587772 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587777 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587782 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587786 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587790 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587794 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587798 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587801 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587805 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587809 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587813 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587817 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587821 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587824 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587828 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587832 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587836 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587840 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:18.925989 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587844 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587847 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587851 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587854 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587859 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587862 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587868 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587872 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587876 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587880 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587884 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587889 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587893 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587897 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587901 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587906 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587910 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587914 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587918 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587922 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:18.926523 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587925 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587929 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587933 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587937 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587942 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587947 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587953 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587959 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587963 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587967 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587972 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587976 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587980 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587984 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587988 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587992 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587995 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.587999 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588003 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:18.927155 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588007 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588010 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588014 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588018 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588023 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588027 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588031 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588035 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588040 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588044 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588047 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588051 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588055 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588059 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588063 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588066 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588070 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588074 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588078 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:18.927685 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.588082 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.588883 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.596099 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.596115 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.597764 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.597772 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597831 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597836 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597839 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597843 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597846 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597849 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597852 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597855 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:18.928225 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597857 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597860 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597862 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597865 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597868 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597871 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597873 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597876 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597878 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597881 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597884 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597887 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597891 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597895 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597900 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597903 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597906 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597908 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597911 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597914 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:18.928676 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597916 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597919 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597922 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597924 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597927 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597929 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597933 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597936 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597939 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597941 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597944 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597947 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597949 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597952 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597954 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597957 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597959 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597962 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597964 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597967 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:19.028956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597969 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597972 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597975 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597978 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597980 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597983 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597987 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597989 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597992 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597994 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597996 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.597999 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598001 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598004 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598007 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598009 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598012 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598014 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598018 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:19.030272 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598022 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598026 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598030 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598033 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598036 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598039 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598041 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598044 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598046 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598049 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598052 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598054 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598057 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598060 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598062 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598064 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598067 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598071 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598073 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:19.031233 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598078 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598080 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598083 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598085 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598088 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598090 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598093 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598095 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598098 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598100 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598103 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598105 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598109 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.598114 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598230 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:01:19.032008 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598234 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598237 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598240 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598243 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598246 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598249 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598252 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598254 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598257 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598260 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598262 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598266 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598270 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598273 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598275 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598278 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598282 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598284 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598289 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:01:19.032710 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598291 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598294 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598296 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598299 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598301 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598304 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598307 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598311 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598313 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598316 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598320 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598323 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598326 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598328 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598331 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598333 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598336 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598338 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598341 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598343 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:01:19.033391 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598346 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598348 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598351 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598353 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598356 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598358 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598360 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598363 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598366 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598368 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598371 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598375 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598377 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598380 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598382 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598385 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598387 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598390 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598392 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598395 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:01:19.034116 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598398 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598400 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598404 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598407 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598409 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598412 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598414 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598417 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598419 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598422 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598424 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598427 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598429 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598432 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598434 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598437 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598439 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598442 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598444 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598447 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:01:19.034802 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598449 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598452 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598454 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598459 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598462 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598464 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598466 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598469 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598471 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598474 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598477 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598479 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598482 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598484 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598488 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598491 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598493 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598496 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:01:19.035488 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:18.598500 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.598505 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.598604 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.601450 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.602908 2564 server.go:1019] "Starting client certificate rotation" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.603003 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.603072 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.605760 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.606849 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.621367 2564 log.go:25] "Validated CRI v1 runtime API" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.623958 2564 log.go:25] "Validated CRI v1 image API" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.624768 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 23:01:19.036184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.628582 2564 fs.go:135] Filesystem UUIDs: map[3d95464c-9714-40e1-bb59-764214969cc7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c599fc38-53fa-4626-97fb-220d1ed514d9:/dev/nvme0n1p4] Jul 02 23:01:19.036897 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.628603 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.632755 2564 manager.go:216] Machine: {Timestamp:2026-07-02 23:01:18.632262899 +0000 UTC m=+0.379562000 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100610 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d6cab55c66d64a95992e383503ab2 SystemUUID:ec2d6cab-55c6-6d64-a959-92e383503ab2 BootID:3474eb0e-ebe9-4ec2-bc16-020a40384cae Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:73:94:26:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:73:94:26:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:0a:e4:e2:dc:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.632855 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.632927 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.635284 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.636445 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.636473 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 23:01:19.037233 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.637907 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.637920 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.637927 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.637942 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.639594 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643302 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643438 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643476 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643488 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643506 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643514 2564 kubelet.go:398] "Adding apiserver pod source" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643524 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643871 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.643885 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.647649 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.650026 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.650053 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652117 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652134 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652143 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652151 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652164 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652173 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652185 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652193 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652202 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652209 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652228 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.652235 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.653222 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.653234 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.654761 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.654763 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.654767 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.656944 2564 server.go:1268] "Started kubelet" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.658101 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.658178 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.657030 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.660158 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.660882 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 02 23:01:19.037575 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.666812 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.672747 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.672771 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.672872 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673454 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673458 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673488 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673567 2564 factory.go:55] Registering systemd factory Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673584 2564 factory.go:223] Registration of the systemd container factory successfully Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673601 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673610 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673826 2564 factory.go:153] Registering CRI-O factory Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673840 2564 factory.go:223] Registration of the crio container factory successfully Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673893 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673917 2564 factory.go:103] Registering Raw factory Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.673932 2564 manager.go:1196] Started watching for new ooms in manager Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.674301 2564 manager.go:349] Starting recovery of all containers Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.677242 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.677295 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.677350 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-1.ec2.internal.18be9b51ed0b9c8a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-1.ec2.internal,UID:ip-10-0-132-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-1.ec2.internal,},FirstTimestamp:2026-07-02 23:01:18.656912522 +0000 UTC m=+0.404211623,LastTimestamp:2026-07-02 23:01:18.656912522 +0000 UTC m=+0.404211623,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-1.ec2.internal,}" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.681983 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9bclz" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.684551 2564 manager.go:354] Recovery completed Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.689046 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9bclz" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.689655 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.691492 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.691534 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.691555 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692124 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692132 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692138 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692150 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692850 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692872 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.042172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.692882 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.693341 2564 policy_none.go:49] "None policy: Start" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.693363 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.693398 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.693506 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-1.ec2.internal.18be9b51ef1ba4d8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-1.ec2.internal,UID:ip-10-0-132-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-1.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-1.ec2.internal,},FirstTimestamp:2026-07-02 23:01:18.691517656 +0000 UTC m=+0.438816757,LastTimestamp:2026-07-02 23:01:18.691517656 +0000 UTC m=+0.438816757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-1.ec2.internal,}" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.694318 2564 policy_none.go:47] "Start" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741312 2564 manager.go:337] "Starting Device Plugin manager" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.741345 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741357 2564 server.go:87] "Starting device plugin registration server" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741653 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741678 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741849 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741931 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.741940 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.742393 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.742446 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.753840 2564 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2596 into the system container \"/system.slice\": " Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.841770 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.842853 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.842878 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.842888 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.842914 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.852340 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.852358 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-1.ec2.internal\": node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.873777 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.918035 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.919423 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.919467 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.919492 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.919532 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:18.923843 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:18.974469 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.043240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.019719 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal"] Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.019805 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.020816 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.020847 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.020860 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023071 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023215 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023954 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023973 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023987 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.023990 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.024003 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.024008 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.026016 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.026036 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.026610 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.026624 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:01:19.045313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.026635 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:01:19.139033 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.075407 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.139033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.076506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.139033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.076533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.139033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.076550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918217da534bcc19f9a258e306b2a309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-1.ec2.internal\" (UID: \"918217da534bcc19f9a258e306b2a309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.175483 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918217da534bcc19f9a258e306b2a309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-1.ec2.internal\" (UID: \"918217da534bcc19f9a258e306b2a309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/918217da534bcc19f9a258e306b2a309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-1.ec2.internal\" (UID: \"918217da534bcc19f9a258e306b2a309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.240902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.177801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce45a2b816ecc58b63d80b4651e29a61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" (UID: \"ce45a2b816ecc58b63d80b4651e29a61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.341035 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.275926 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.443654 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.376470 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.546335 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.476940 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.657775 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:19.577481 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-1.ec2.internal\" not found" Jul 02 23:01:19.657775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.601712 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 23:01:19.657775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.601866 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 23:01:19.670365 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.669329 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:01:19.676577 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.673490 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 23:01:19.676577 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.673492 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.688449 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.693271 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.694330 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 22:56:19 +0000 UTC" deadline="2027-12-12 18:30:09.803210958 +0000 UTC" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.694351 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12667h28m50.10886241s" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.695522 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.707274 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.713051 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g7dbm" Jul 02 23:01:19.766734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.721350 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g7dbm" Jul 02 23:01:19.994470 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:19.994449 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:01:20.015471 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.015449 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:01:20.103903 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.103872 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.108560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.108543 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.118163 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.118144 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:01:20.118225 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.118196 2564 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.118606 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.118580 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:01:20.118643 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.118633 2564 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-1.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.119499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.119478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.121545 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.121529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" Jul 02 23:01:20.644437 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.644408 2564 apiserver.go:52] "Watching apiserver" Jul 02 23:01:20.653987 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.653955 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 23:01:20.655579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.655544 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ftr95","kube-system/global-pull-secret-syncer-fdskt","openshift-cluster-node-tuning-operator/tuned-h8rvq","openshift-dns/node-resolver-fcnrf","openshift-image-registry/node-ca-jx26x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal","openshift-multus/network-metrics-daemon-6gphg","openshift-network-diagnostics/network-check-target-lnjh8","kube-system/konnectivity-agent-mqhst","kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9","openshift-multus/multus-additional-cni-plugins-gjp5x","openshift-multus/multus-fqnnc","openshift-network-operator/iptables-alerter-dnwgm"] Jul 02 23:01:20.658739 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.658713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.661348 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.661322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.661465 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.661409 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vnjrj\"" Jul 02 23:01:20.661465 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.661416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 23:01:20.661549 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.661413 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 23:01:20.663757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.663717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c26sq\"" Jul 02 23:01:20.664049 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.663898 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.664049 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.663989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.664787 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.664163 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.664787 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.664483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 23:01:20.666361 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.666336 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.666460 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.666430 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pvwxj\"" Jul 02 23:01:20.666557 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.666541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.666622 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.666574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.668925 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.668905 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 23:01:20.669369 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669201 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 23:01:20.669369 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.669369 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669310 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.669619 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8htz\"" Jul 02 23:01:20.669695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.669763 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.669736 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:01:20.672109 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.672076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 23:01:20.672223 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.672137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.672342 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.672327 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 23:01:20.672601 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.672585 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9qjm6\"" Jul 02 23:01:20.674669 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.674493 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 23:01:20.674854 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.674834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.675070 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.674916 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:20.675161 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.675096 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.675236 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.675170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.675303 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.675285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kn928\"" Jul 02 23:01:20.677638 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.677615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:20.677713 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.677696 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:20.679846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.679829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.682331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.682312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.682426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.682379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.682543 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.682426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g6rzb\"" Jul 02 23:01:20.683405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.683388 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.684948 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.684920 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.685065 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.684997 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.685135 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nwnf2\"" Jul 02 23:01:20.685135 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685106 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 23:01:20.685532 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-cnibin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-multus-daemon-config\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.685962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgcm\" (UniqueName: \"kubernetes.io/projected/be76cd96-36ba-4c2d-bb25-b301b550b260-kube-api-access-bwgcm\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cnibin\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-systemd\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-tuned\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-cni-binary-copy\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-hostroot\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-conf-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2dkh\" (UniqueName: \"kubernetes.io/projected/523f04e9-208a-445f-b131-4daf5c7fe32e-kube-api-access-q2dkh\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-bin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9507be0f-5079-4fa0-b6da-b049da8814ed-agent-certs\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysconfig\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-conf\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-lib-modules\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qprmz\" (UniqueName: \"kubernetes.io/projected/6649b25d-16d3-48a6-88b1-540638b589de-kube-api-access-qprmz\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be76cd96-36ba-4c2d-bb25-b301b550b260-iptables-alerter-script\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be76cd96-36ba-4c2d-bb25-b301b550b260-host-slash\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-kubernetes\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.686650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-host\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-system-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-k8s-cni-cncf-io\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-device-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-etc-selinux\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-multus-certs\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-etc-kubernetes\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-os-release\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssqkr\" (UniqueName: \"kubernetes.io/projected/169f0f04-856b-4681-98b6-e79693b73428-kube-api-access-ssqkr\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-sys\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-os-release\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-multus\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.687517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-kubelet\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.686986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-sys-fs\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-run\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdg4n\" (UniqueName: \"kubernetes.io/projected/5ceb7ada-76cc-416e-932e-b691a23da0bd-kube-api-access-qdg4n\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-netns\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-system-cni-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-modprobe-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-socket-dir-parent\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkszq\" (UniqueName: \"kubernetes.io/projected/f5645fcf-cc4a-48a1-8ff6-707af076eab3-kube-api-access-xkszq\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.688158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-socket-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.688589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-registration-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.688589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9507be0f-5079-4fa0-b6da-b049da8814ed-konnectivity-ca\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.688589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-var-lib-kubelet\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.688589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.687396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-tmp\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.688589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.688074 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 23:01:20.688774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.688693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.688774 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.688754 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:20.689007 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.688983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xbbbq\"" Jul 02 23:01:20.689121 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.689022 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 23:01:20.689121 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.689054 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 23:01:20.689121 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.689080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 23:01:20.689260 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.689122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 23:01:20.689260 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.689117 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 23:01:20.724756 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.724707 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 22:56:20 +0000 UTC" deadline="2027-11-26 17:10:01.077366985 +0000 UTC" Jul 02 23:01:20.724850 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.724757 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12282h8m40.352614023s" Jul 02 23:01:20.762429 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:20.762398 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918217da534bcc19f9a258e306b2a309.slice/crio-73cc81fc81d65fa41e94b97f3186a91560929df2932fe346f644e2bf0bfd1f9b WatchSource:0}: Error finding container 73cc81fc81d65fa41e94b97f3186a91560929df2932fe346f644e2bf0bfd1f9b: Status 404 returned error can't find the container with id 73cc81fc81d65fa41e94b97f3186a91560929df2932fe346f644e2bf0bfd1f9b Jul 02 23:01:20.762838 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:20.762817 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce45a2b816ecc58b63d80b4651e29a61.slice/crio-8840f0362b0fdf3061d407202f3719884b996932a08abb807b7a4294009f9340 WatchSource:0}: Error finding container 8840f0362b0fdf3061d407202f3719884b996932a08abb807b7a4294009f9340: Status 404 returned error can't find the container with id 8840f0362b0fdf3061d407202f3719884b996932a08abb807b7a4294009f9340 Jul 02 23:01:20.770129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.770101 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:01:20.775220 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.775201 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 23:01:20.787920 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.787885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-etc-selinux\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.788096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.787939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29418216-89f4-4344-9e92-14273638d7c4-ovn-node-metrics-cert\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.787969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssqkr\" (UniqueName: \"kubernetes.io/projected/169f0f04-856b-4681-98b6-e79693b73428-kube-api-access-ssqkr\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.788096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.787979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-etc-selinux\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.788096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.787993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.788096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-system-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-k8s-cni-cncf-io\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788180 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-k8s-cni-cncf-io\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-dbus\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9r9\" (UniqueName: \"kubernetes.io/projected/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-kube-api-access-6l9r9\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-log-socket\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-config\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-system-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-multus-certs\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-os-release\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-multus-certs\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-node-log\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-env-overrides\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vldrx\" (UniqueName: \"kubernetes.io/projected/29418216-89f4-4344-9e92-14273638d7c4-kube-api-access-vldrx\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-os-release\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-sys\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-kubelet\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-kubelet\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdg4n\" (UniqueName: \"kubernetes.io/projected/5ceb7ada-76cc-416e-932e-b691a23da0bd-kube-api-access-qdg4n\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.788792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-sys\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-netns\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-system-cni-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-run-netns\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-modprobe-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-modprobe-d\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-socket-dir-parent\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-system-cni-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.788996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-kubelet\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-socket-dir-parent\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9507be0f-5079-4fa0-b6da-b049da8814ed-konnectivity-ca\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.789500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-var-lib-kubelet\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-tmp\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-cnibin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.789132 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgcm\" (UniqueName: \"kubernetes.io/projected/be76cd96-36ba-4c2d-bb25-b301b550b260-kube-api-access-bwgcm\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.789187 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:21.289170906 +0000 UTC m=+3.036469998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-ovn\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-tuned\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-var-lib-kubelet\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2dkh\" (UniqueName: \"kubernetes.io/projected/523f04e9-208a-445f-b131-4daf5c7fe32e-kube-api-access-q2dkh\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.790266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-kubelet-config\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-systemd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-etc-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9507be0f-5079-4fa0-b6da-b049da8814ed-agent-certs\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-conf\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qprmz\" (UniqueName: \"kubernetes.io/projected/6649b25d-16d3-48a6-88b1-540638b589de-kube-api-access-qprmz\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be76cd96-36ba-4c2d-bb25-b301b550b260-iptables-alerter-script\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-netns\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-kubernetes\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789576 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-host\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9507be0f-5079-4fa0-b6da-b049da8814ed-konnectivity-ca\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.791046 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33411e0d-67c4-4133-b062-c6f8d19653fd-host\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-var-lib-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysctl-conf\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-bin\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789818 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-kubernetes\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-etc-kubernetes\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-host\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-cnibin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790026 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-etc-kubernetes\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.789985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-tmp-dir\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/33411e0d-67c4-4133-b062-c6f8d19653fd-kube-api-access-h8w8x\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-os-release\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-multus\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be76cd96-36ba-4c2d-bb25-b301b550b260-iptables-alerter-script\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.791560 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-multus\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-sys-fs\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-run\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-os-release\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-hosts-file\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-run\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-systemd-units\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkszq\" (UniqueName: \"kubernetes.io/projected/f5645fcf-cc4a-48a1-8ff6-707af076eab3-kube-api-access-xkszq\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-socket-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-sys-fs\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790505 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-cni-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-registration-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33411e0d-67c4-4133-b062-c6f8d19653fd-serviceca\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-socket-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-slash\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-registration-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-netd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-multus-daemon-config\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cnibin\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-script-lib\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-systemd\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5645fcf-cc4a-48a1-8ff6-707af076eab3-cnibin\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-cni-binary-copy\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-hostroot\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-conf-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-systemd\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-bin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-host-var-lib-cni-bin\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-hostroot\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.790989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysconfig\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-sysconfig\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-lib-modules\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be76cd96-36ba-4c2d-bb25-b301b550b260-host-slash\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-device-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ceb7ada-76cc-416e-932e-b691a23da0bd-lib-modules\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791110 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6649b25d-16d3-48a6-88b1-540638b589de-multus-conf-dir\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be76cd96-36ba-4c2d-bb25-b301b550b260-host-slash\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791277 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/169f0f04-856b-4681-98b6-e79693b73428-device-dir\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-multus-daemon-config\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.792931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.791347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6649b25d-16d3-48a6-88b1-540638b589de-cni-binary-copy\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.793419 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.793399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-tmp\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.793452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.793426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ceb7ada-76cc-416e-932e-b691a23da0bd-etc-tuned\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.793486 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.793470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9507be0f-5079-4fa0-b6da-b049da8814ed-agent-certs\") pod \"konnectivity-agent-mqhst\" (UID: \"9507be0f-5079-4fa0-b6da-b049da8814ed\") " pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.812938 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.812908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdg4n\" (UniqueName: \"kubernetes.io/projected/5ceb7ada-76cc-416e-932e-b691a23da0bd-kube-api-access-qdg4n\") pod \"tuned-h8rvq\" (UID: \"5ceb7ada-76cc-416e-932e-b691a23da0bd\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:20.813084 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.812907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2dkh\" (UniqueName: \"kubernetes.io/projected/523f04e9-208a-445f-b131-4daf5c7fe32e-kube-api-access-q2dkh\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:20.814669 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.814640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qprmz\" (UniqueName: \"kubernetes.io/projected/6649b25d-16d3-48a6-88b1-540638b589de-kube-api-access-qprmz\") pod \"multus-fqnnc\" (UID: \"6649b25d-16d3-48a6-88b1-540638b589de\") " pod="openshift-multus/multus-fqnnc" Jul 02 23:01:20.815028 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.815009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgcm\" (UniqueName: \"kubernetes.io/projected/be76cd96-36ba-4c2d-bb25-b301b550b260-kube-api-access-bwgcm\") pod \"iptables-alerter-dnwgm\" (UID: \"be76cd96-36ba-4c2d-bb25-b301b550b260\") " pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:20.815102 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.815070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssqkr\" (UniqueName: \"kubernetes.io/projected/169f0f04-856b-4681-98b6-e79693b73428-kube-api-access-ssqkr\") pod \"aws-ebs-csi-driver-node-j45n9\" (UID: \"169f0f04-856b-4681-98b6-e79693b73428\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:20.821487 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.821456 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkszq\" (UniqueName: \"kubernetes.io/projected/f5645fcf-cc4a-48a1-8ff6-707af076eab3-kube-api-access-xkszq\") pod \"multus-additional-cni-plugins-gjp5x\" (UID: \"f5645fcf-cc4a-48a1-8ff6-707af076eab3\") " pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:20.891545 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29418216-89f4-4344-9e92-14273638d7c4-ovn-node-metrics-cert\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891545 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-dbus\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.891545 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9r9\" (UniqueName: \"kubernetes.io/projected/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-kube-api-access-6l9r9\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-log-socket\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-config\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-node-log\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-dbus\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-log-socket\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-env-overrides\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891715 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vldrx\" (UniqueName: \"kubernetes.io/projected/29418216-89f4-4344-9e92-14273638d7c4-kube-api-access-vldrx\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.891778 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891769 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-node-log\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891956 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.891985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-kubelet\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-ovn\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-kubelet\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-kubelet-config\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-systemd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-kubelet-config\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-etc-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-ovn\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-run-systemd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-netns\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-etc-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33411e0d-67c4-4133-b062-c6f8d19653fd-host\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-var-lib-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-bin\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-run-netns\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33411e0d-67c4-4133-b062-c6f8d19653fd-host\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-env-overrides\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-tmp-dir\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-bin\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/33411e0d-67c4-4133-b062-c6f8d19653fd-kube-api-access-h8w8x\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-hosts-file\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-systemd-units\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:20.892817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-var-lib-openvswitch\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-hosts-file\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33411e0d-67c4-4133-b062-c6f8d19653fd-serviceca\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-slash\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.892469 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-netd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.892518 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:21.39249877 +0000 UTC m=+3.139797860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-slash\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-script-lib\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-systemd-units\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29418216-89f4-4344-9e92-14273638d7c4-host-cni-netd\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-tmp-dir\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33411e0d-67c4-4133-b062-c6f8d19653fd-serviceca\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.892920 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-config\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.893279 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.893073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29418216-89f4-4344-9e92-14273638d7c4-ovnkube-script-lib\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.894130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.894114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29418216-89f4-4344-9e92-14273638d7c4-ovn-node-metrics-cert\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.904114 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.904090 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:20.904114 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.904117 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:20.904270 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.904132 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:20.904270 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:20.904204 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:21.404183767 +0000 UTC m=+3.151482883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:20.905927 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.905897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vldrx\" (UniqueName: \"kubernetes.io/projected/29418216-89f4-4344-9e92-14273638d7c4-kube-api-access-vldrx\") pod \"ovnkube-node-ftr95\" (UID: \"29418216-89f4-4344-9e92-14273638d7c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:20.906024 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.905978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9r9\" (UniqueName: \"kubernetes.io/projected/b5a3d848-0a79-4a9a-b62c-98a124b5d0be-kube-api-access-6l9r9\") pod \"node-resolver-fcnrf\" (UID: \"b5a3d848-0a79-4a9a-b62c-98a124b5d0be\") " pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:20.906110 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.906091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8w8x\" (UniqueName: \"kubernetes.io/projected/33411e0d-67c4-4133-b062-c6f8d19653fd-kube-api-access-h8w8x\") pod \"node-ca-jx26x\" (UID: \"33411e0d-67c4-4133-b062-c6f8d19653fd\") " pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:20.928615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.928562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" event={"ID":"ce45a2b816ecc58b63d80b4651e29a61","Type":"ContainerStarted","Data":"8840f0362b0fdf3061d407202f3719884b996932a08abb807b7a4294009f9340"} Jul 02 23:01:20.929539 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.929516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" event={"ID":"918217da534bcc19f9a258e306b2a309","Type":"ContainerStarted","Data":"73cc81fc81d65fa41e94b97f3186a91560929df2932fe346f644e2bf0bfd1f9b"} Jul 02 23:01:20.979025 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.978989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:20.989700 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:20.989653 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9507be0f_5079_4fa0_b6da_b049da8814ed.slice/crio-597d1cef8283d447165676506c5e0303dd83f60c41707bbd5439131985feac10 WatchSource:0}: Error finding container 597d1cef8283d447165676506c5e0303dd83f60c41707bbd5439131985feac10: Status 404 returned error can't find the container with id 597d1cef8283d447165676506c5e0303dd83f60c41707bbd5439131985feac10 Jul 02 23:01:20.996079 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:20.996059 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnwgm" Jul 02 23:01:21.005469 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.005440 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe76cd96_36ba_4c2d_bb25_b301b550b260.slice/crio-cd7f3bc4297169f499812521b8981491cc5534ed43afbbd4315ecfc985f98d16 WatchSource:0}: Error finding container cd7f3bc4297169f499812521b8981491cc5534ed43afbbd4315ecfc985f98d16: Status 404 returned error can't find the container with id cd7f3bc4297169f499812521b8981491cc5534ed43afbbd4315ecfc985f98d16 Jul 02 23:01:21.013757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.013726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" Jul 02 23:01:21.019080 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.019057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fqnnc" Jul 02 23:01:21.023497 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.023474 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ceb7ada_76cc_416e_932e_b691a23da0bd.slice/crio-3a5d5ea727f112fe35f1cbfe145aafd8169b094e6c6fdb166278a4059bc21bd4 WatchSource:0}: Error finding container 3a5d5ea727f112fe35f1cbfe145aafd8169b094e6c6fdb166278a4059bc21bd4: Status 404 returned error can't find the container with id 3a5d5ea727f112fe35f1cbfe145aafd8169b094e6c6fdb166278a4059bc21bd4 Jul 02 23:01:21.028654 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.028634 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6649b25d_16d3_48a6_88b1_540638b589de.slice/crio-d9f3d4eac3fac3f5e9cb3554f80aa918fb6eabe61e026054c1a464744ef4b9a5 WatchSource:0}: Error finding container d9f3d4eac3fac3f5e9cb3554f80aa918fb6eabe61e026054c1a464744ef4b9a5: Status 404 returned error can't find the container with id d9f3d4eac3fac3f5e9cb3554f80aa918fb6eabe61e026054c1a464744ef4b9a5 Jul 02 23:01:21.035719 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.035690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" Jul 02 23:01:21.045922 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.045889 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5645fcf_cc4a_48a1_8ff6_707af076eab3.slice/crio-d1e55e310d6b569fb52981871a2cf4e9675432a390cd9e1a5ee1f665968a8d46 WatchSource:0}: Error finding container d1e55e310d6b569fb52981871a2cf4e9675432a390cd9e1a5ee1f665968a8d46: Status 404 returned error can't find the container with id d1e55e310d6b569fb52981871a2cf4e9675432a390cd9e1a5ee1f665968a8d46 Jul 02 23:01:21.051577 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.051557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" Jul 02 23:01:21.057159 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.057140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcnrf" Jul 02 23:01:21.060161 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.060132 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169f0f04_856b_4681_98b6_e79693b73428.slice/crio-136f0aa6c9b978aff59ed5fbd7510c298df981ccf9376ed5f5dbb08e9a03968d WatchSource:0}: Error finding container 136f0aa6c9b978aff59ed5fbd7510c298df981ccf9376ed5f5dbb08e9a03968d: Status 404 returned error can't find the container with id 136f0aa6c9b978aff59ed5fbd7510c298df981ccf9376ed5f5dbb08e9a03968d Jul 02 23:01:21.065734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.065714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jx26x" Jul 02 23:01:21.066009 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.065984 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a3d848_0a79_4a9a_b62c_98a124b5d0be.slice/crio-364a54cf3dd0a38c5bb14055717bbad3caa8ebe6940493db8e58762ef250a837 WatchSource:0}: Error finding container 364a54cf3dd0a38c5bb14055717bbad3caa8ebe6940493db8e58762ef250a837: Status 404 returned error can't find the container with id 364a54cf3dd0a38c5bb14055717bbad3caa8ebe6940493db8e58762ef250a837 Jul 02 23:01:21.071884 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.071864 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:21.075105 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.075082 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33411e0d_67c4_4133_b062_c6f8d19653fd.slice/crio-7f539352f4cfcaf97c6dae994ba891b3590aaa7e5ce1f07f16a960a563ecbe0c WatchSource:0}: Error finding container 7f539352f4cfcaf97c6dae994ba891b3590aaa7e5ce1f07f16a960a563ecbe0c: Status 404 returned error can't find the container with id 7f539352f4cfcaf97c6dae994ba891b3590aaa7e5ce1f07f16a960a563ecbe0c Jul 02 23:01:21.080938 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:21.080910 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29418216_89f4_4344_9e92_14273638d7c4.slice/crio-f18d4ef1739e7332a1af8eeb1ca5ff0be77d6e75eb200d53bbdd8adceeb5ac97 WatchSource:0}: Error finding container f18d4ef1739e7332a1af8eeb1ca5ff0be77d6e75eb200d53bbdd8adceeb5ac97: Status 404 returned error can't find the container with id f18d4ef1739e7332a1af8eeb1ca5ff0be77d6e75eb200d53bbdd8adceeb5ac97 Jul 02 23:01:21.296344 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.296307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:21.296507 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.296484 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:21.296573 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.296557 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:22.296540084 +0000 UTC m=+4.043839175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:21.396754 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.396703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:21.396949 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.396878 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:21.397067 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.397046 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:22.396968038 +0000 UTC m=+4.144267154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:21.498886 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.498211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:21.498886 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.498405 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:21.498886 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.498425 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:21.498886 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.498439 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:21.498886 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.498504 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:22.498485259 +0000 UTC m=+4.245784349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:21.725892 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.725728 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 22:56:20 +0000 UTC" deadline="2028-02-03 01:55:37.071634692 +0000 UTC" Jul 02 23:01:21.725892 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.725799 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13922h54m15.345840757s" Jul 02 23:01:21.919893 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.919849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:21.920048 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:21.920009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:21.959687 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.959577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jx26x" event={"ID":"33411e0d-67c4-4133-b062-c6f8d19653fd","Type":"ContainerStarted","Data":"7f539352f4cfcaf97c6dae994ba891b3590aaa7e5ce1f07f16a960a563ecbe0c"} Jul 02 23:01:21.988310 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:21.988207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcnrf" event={"ID":"b5a3d848-0a79-4a9a-b62c-98a124b5d0be","Type":"ContainerStarted","Data":"364a54cf3dd0a38c5bb14055717bbad3caa8ebe6940493db8e58762ef250a837"} Jul 02 23:01:22.007028 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.006980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" event={"ID":"169f0f04-856b-4681-98b6-e79693b73428","Type":"ContainerStarted","Data":"136f0aa6c9b978aff59ed5fbd7510c298df981ccf9376ed5f5dbb08e9a03968d"} Jul 02 23:01:22.023697 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.023650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqnnc" event={"ID":"6649b25d-16d3-48a6-88b1-540638b589de","Type":"ContainerStarted","Data":"d9f3d4eac3fac3f5e9cb3554f80aa918fb6eabe61e026054c1a464744ef4b9a5"} Jul 02 23:01:22.041493 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.041373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" event={"ID":"5ceb7ada-76cc-416e-932e-b691a23da0bd","Type":"ContainerStarted","Data":"3a5d5ea727f112fe35f1cbfe145aafd8169b094e6c6fdb166278a4059bc21bd4"} Jul 02 23:01:22.054164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.054072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnwgm" event={"ID":"be76cd96-36ba-4c2d-bb25-b301b550b260","Type":"ContainerStarted","Data":"cd7f3bc4297169f499812521b8981491cc5534ed43afbbd4315ecfc985f98d16"} Jul 02 23:01:22.062202 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.062073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqhst" event={"ID":"9507be0f-5079-4fa0-b6da-b049da8814ed","Type":"ContainerStarted","Data":"597d1cef8283d447165676506c5e0303dd83f60c41707bbd5439131985feac10"} Jul 02 23:01:22.065730 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.065610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"f18d4ef1739e7332a1af8eeb1ca5ff0be77d6e75eb200d53bbdd8adceeb5ac97"} Jul 02 23:01:22.069187 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.069114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerStarted","Data":"d1e55e310d6b569fb52981871a2cf4e9675432a390cd9e1a5ee1f665968a8d46"} Jul 02 23:01:22.306317 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.306221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:22.306526 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.306411 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:22.306526 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.306500 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:24.306477958 +0000 UTC m=+6.053777096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:22.407407 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.407363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:22.407606 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.407583 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:22.407685 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.407649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:24.407630445 +0000 UTC m=+6.154929561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:22.508607 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.508567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:22.508827 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.508764 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:22.508827 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.508786 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:22.508827 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.508801 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:22.509012 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.508862 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:24.508841767 +0000 UTC m=+6.256140879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:22.920918 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.920884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:22.921144 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.921029 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:22.921144 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:22.921084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:22.921259 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:22.921221 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:23.920593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:23.920554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:23.921529 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:23.920714 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:24.327879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:24.327839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:24.328065 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.327991 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:24.328065 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.328056 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:28.328033812 +0000 UTC m=+10.075332949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:24.428421 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:24.428385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:24.428604 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.428565 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:24.428689 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.428624 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:28.428606219 +0000 UTC m=+10.175905310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:24.528804 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:24.528761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:24.529014 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.528999 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:24.529078 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.529024 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:24.529078 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.529038 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:24.529184 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.529097 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:28.529078154 +0000 UTC m=+10.276377262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:24.920658 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:24.920624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:24.921181 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:24.920628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:24.921181 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.920807 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:24.921181 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:24.920892 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:25.920723 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:25.920687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:25.921252 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:25.920830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:26.919802 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:26.919765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:26.920004 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:26.919922 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:26.920304 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:26.920269 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:26.920433 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:26.920403 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:27.920447 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:27.920415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:27.920990 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:27.920529 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:28.361140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:28.361096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:28.361314 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.361241 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:28.361393 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.361323 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.361298704 +0000 UTC m=+18.108597816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:28.462247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:28.462211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:28.462440 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.462345 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:28.462440 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.462405 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.462387571 +0000 UTC m=+18.209686678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:28.562929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:28.562894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:28.563109 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.563092 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:28.563196 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.563124 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:28.563196 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.563141 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:28.563299 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.563203 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.563181187 +0000 UTC m=+18.310480295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:28.921200 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:28.921147 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:28.921590 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.921265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:28.921744 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:28.921720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:28.921912 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:28.921873 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:29.920492 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:29.920450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:29.920673 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:29.920598 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:30.923182 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:30.922481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:30.923182 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:30.922617 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:30.923182 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:30.923016 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:30.923182 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:30.923123 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:31.920166 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:31.920127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:31.920332 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:31.920256 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:32.919741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:32.919708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:32.920126 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:32.919817 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:32.920126 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:32.919848 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:32.920126 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:32.919904 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:33.920482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:33.920442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:33.920944 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:33.920592 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:34.919887 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:34.919856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:34.920074 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:34.919981 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:34.920074 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:34.920044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:34.920188 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:34.920161 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:35.920287 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:35.920250 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:35.920773 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:35.920369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:36.428449 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:36.428405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:36.428648 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.428512 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:36.428648 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.428563 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:01:52.428549607 +0000 UTC m=+34.175848695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:36.529414 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:36.529374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:36.529575 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.529516 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:36.529616 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.529583 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:52.529566075 +0000 UTC m=+34.276865166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:36.630427 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:36.630384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:36.630613 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.630551 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:36.630613 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.630569 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:36.630613 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.630579 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:36.630799 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.630633 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:52.630615586 +0000 UTC m=+34.377914688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:36.920685 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:36.920630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:36.921155 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:36.920630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:36.921155 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.920803 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:36.921155 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:36.920940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:37.920762 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:37.920652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:37.921212 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:37.920804 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:38.921883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:38.920858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:38.921883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:38.920946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:38.921883 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:38.921177 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:38.921883 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:38.921284 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:39.919886 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:39.919834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:39.920061 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:39.919962 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:40.920247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:40.920208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:40.920700 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:40.920349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:40.920700 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:40.920445 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:40.920700 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:40.920343 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:41.920297 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:41.920270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:41.920658 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:41.920388 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:42.124411 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.124377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" event={"ID":"918217da534bcc19f9a258e306b2a309","Type":"ContainerStarted","Data":"dff3ae0431cbe83bac18eece6690541c23186e0e43afd48231f17d1907c5e6c8"} Jul 02 23:01:42.128610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.128578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"d9072ba5ec72aac04e5e2db4074afaedd21b9209f0b78f14ccda4ed5bed54939"} Jul 02 23:01:42.130370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.130345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fqnnc" event={"ID":"6649b25d-16d3-48a6-88b1-540638b589de","Type":"ContainerStarted","Data":"73feb067116fb6352b03006b697a04259257940dbe53d3761894d3c07f382a52"} Jul 02 23:01:42.133342 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.133318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" event={"ID":"5ceb7ada-76cc-416e-932e-b691a23da0bd","Type":"ContainerStarted","Data":"9aa3c51f4b17df80090277dba42d71aeb22dd27faf4381edffe2144704837dbc"} Jul 02 23:01:42.138196 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.138153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-1.ec2.internal" podStartSLOduration=22.13814014 podStartE2EDuration="22.13814014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:42.137845767 +0000 UTC m=+23.885144878" watchObservedRunningTime="2026-07-02 23:01:42.13814014 +0000 UTC m=+23.885439249" Jul 02 23:01:42.154683 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.154615 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8rvq" podStartSLOduration=2.518180326 podStartE2EDuration="23.154590846s" totalImagesPullingTime="20.63641052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:42.153964715 +0000 UTC m=+23.901263825" watchObservedRunningTime="2026-07-02 23:01:42.154590846 +0000 UTC m=+23.901889958" Jul 02 23:01:42.170841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.170789 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fqnnc" podStartSLOduration=2.505203597 podStartE2EDuration="23.170773432s" totalImagesPullingTime="20.665569835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:42.170698288 +0000 UTC m=+23.917997398" watchObservedRunningTime="2026-07-02 23:01:42.170773432 +0000 UTC m=+23.918072543" Jul 02 23:01:42.920780 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.920544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:42.921373 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:42.920592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:42.921373 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:42.921048 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:42.921373 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:42.920963 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:43.136488 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.136418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqhst" event={"ID":"9507be0f-5079-4fa0-b6da-b049da8814ed","Type":"ContainerStarted","Data":"a34434181591a6e881456f06abd32ca81c48a4a4711eb34fd49308236dca255a"} Jul 02 23:01:43.139170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139138 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:01:43.139468 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139442 2564 generic.go:356] "Generic (PLEG): container finished" podID="29418216-89f4-4344-9e92-14273638d7c4" containerID="2d2fb2f35c3015b7d8852eea2a6bc21953d2f3c53483c5bde3ade822acfe7caf" exitCode=1 Jul 02 23:01:43.139543 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"a83b87408d70f9d982277e93fae91267e271ff5b5feccd557b84aeb05fcb99a8"} Jul 02 23:01:43.139595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"8767e1e6aaf096b66656b9f249abce67fe1046ac840a3a03df8a6268be5374f5"} Jul 02 23:01:43.139635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"aea077a215b5fc4443d6e42e8a516c2980f26f6f3e74fae03740d33a7c53601e"} Jul 02 23:01:43.139688 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"ed3c70b5cca41974c7d7761ce45ae02e359ad48cdf9e7a721fa57035b87b0284"} Jul 02 23:01:43.139758 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.139695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerDied","Data":"2d2fb2f35c3015b7d8852eea2a6bc21953d2f3c53483c5bde3ade822acfe7caf"} Jul 02 23:01:43.141036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.141014 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="b1b35cba509513503884841a65779d34cb74f2aa62dd5c361a7a4c413372c2d5" exitCode=0 Jul 02 23:01:43.141131 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.141075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"b1b35cba509513503884841a65779d34cb74f2aa62dd5c361a7a4c413372c2d5"} Jul 02 23:01:43.142601 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.142581 2564 generic.go:356] "Generic (PLEG): container finished" podID="ce45a2b816ecc58b63d80b4651e29a61" containerID="e40e3c3f9bed32cb0fa6bd6de85e739576a98ac61e8a5bae0e92cd89fd23cd3c" exitCode=0 Jul 02 23:01:43.142710 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.142689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" event={"ID":"ce45a2b816ecc58b63d80b4651e29a61","Type":"ContainerDied","Data":"e40e3c3f9bed32cb0fa6bd6de85e739576a98ac61e8a5bae0e92cd89fd23cd3c"} Jul 02 23:01:43.144126 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.144099 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jx26x" event={"ID":"33411e0d-67c4-4133-b062-c6f8d19653fd","Type":"ContainerStarted","Data":"107441008b0e86f58a286392b410c14373d6a597a6aab71ad51fa77265b679b0"} Jul 02 23:01:43.145511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.145491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcnrf" event={"ID":"b5a3d848-0a79-4a9a-b62c-98a124b5d0be","Type":"ContainerStarted","Data":"51808ba5f2fee2d43eac9ff041746c8345999e2c53a10e8af8d6ad6b70651021"} Jul 02 23:01:43.147284 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.147263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" event={"ID":"169f0f04-856b-4681-98b6-e79693b73428","Type":"ContainerStarted","Data":"c37c1207c778a28a3af0f3e8fe28e98c5df276a460ab8164a7d5d9663bc04d06"} Jul 02 23:01:43.154555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.154510 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mqhst" podStartSLOduration=3.499750085 podStartE2EDuration="24.154492528s" totalImagesPullingTime="20.654742443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:43.154448153 +0000 UTC m=+24.901747263" watchObservedRunningTime="2026-07-02 23:01:43.154492528 +0000 UTC m=+24.901791634" Jul 02 23:01:43.212275 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.212032 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fcnrf" podStartSLOduration=2.633745733 podStartE2EDuration="23.21201436s" totalImagesPullingTime="20.578268627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:43.211497056 +0000 UTC m=+24.958796167" watchObservedRunningTime="2026-07-02 23:01:43.21201436 +0000 UTC m=+24.959313474" Jul 02 23:01:43.228989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.228943 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jx26x" podStartSLOduration=2.644590564 podStartE2EDuration="23.228927634s" totalImagesPullingTime="20.58433707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:43.228899657 +0000 UTC m=+24.976198777" watchObservedRunningTime="2026-07-02 23:01:43.228927634 +0000 UTC m=+24.976226744" Jul 02 23:01:43.919961 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:43.919931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:43.920203 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:43.920036 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:44.151684 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.151631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnwgm" event={"ID":"be76cd96-36ba-4c2d-bb25-b301b550b260","Type":"ContainerStarted","Data":"fb267765155a87a611a148a0a3465d8946b80412d8d8961d53ed5d234d26dcae"} Jul 02 23:01:44.153790 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.153763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" event={"ID":"ce45a2b816ecc58b63d80b4651e29a61","Type":"ContainerStarted","Data":"7c1f90f0c3111b16d4bb17201d917bd60ed3c2421b83bd7d0bf8232fa6ac9143"} Jul 02 23:01:44.167384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.167335 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dnwgm" podStartSLOduration=4.528718081 podStartE2EDuration="25.167321472s" totalImagesPullingTime="20.638603391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:44.167235343 +0000 UTC m=+25.914534452" watchObservedRunningTime="2026-07-02 23:01:44.167321472 +0000 UTC m=+25.914620579" Jul 02 23:01:44.182398 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.182333 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-1.ec2.internal" podStartSLOduration=24.182320721 podStartE2EDuration="24.182320721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:44.182175837 +0000 UTC m=+25.929474949" watchObservedRunningTime="2026-07-02 23:01:44.182320721 +0000 UTC m=+25.929619831" Jul 02 23:01:44.887341 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.887312 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 23:01:44.920889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.920809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:44.921017 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:44.920817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:44.921017 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:44.920912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:44.921017 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:44.920979 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:45.156888 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.156853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" event={"ID":"169f0f04-856b-4681-98b6-e79693b73428","Type":"ContainerStarted","Data":"c3b5a02986c9e698c71e311d9f16d6bc24626afaf6fc0a7a2c25adcd0ef7bbf8"} Jul 02 23:01:45.159569 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.159551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:01:45.159884 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.159864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"eb9762dc93b77abb1ad0b8c44a522730afc7d5b1bef179a035a4f76bb701c70c"} Jul 02 23:01:45.756058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.755956 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:01:44.887334576Z","UUID":"0f086536-ddd7-4c12-9292-f5286603550f","Handler":null,"Name":"","Endpoint":""} Jul 02 23:01:45.757316 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.757298 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 23:01:45.757446 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.757340 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 23:01:45.920201 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:45.920165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:45.920368 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:45.920314 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:46.085840 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.085806 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:46.086582 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.086561 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:46.163059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.163027 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:46.163683 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.163652 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mqhst" Jul 02 23:01:46.920388 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.920362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:46.920533 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:46.920498 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:46.920615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:46.920555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:46.920706 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:46.920682 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:47.167174 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:47.167081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" event={"ID":"169f0f04-856b-4681-98b6-e79693b73428","Type":"ContainerStarted","Data":"2396c6beb6426d1b44012b114cae4a109792a056c7797ddc9735e828772b43ce"} Jul 02 23:01:47.211358 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:47.211302 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j45n9" podStartSLOduration=4.395832937 podStartE2EDuration="28.211286193s" totalImagesPullingTime="23.815453256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:47.21054527 +0000 UTC m=+28.957844381" watchObservedRunningTime="2026-07-02 23:01:47.211286193 +0000 UTC m=+28.958585305" Jul 02 23:01:47.920643 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:47.920609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:47.920824 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:47.920735 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:48.921317 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:48.921151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:48.921994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:48.921209 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:48.921994 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:48.921380 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:48.921994 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:48.921467 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:49.174974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.174898 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:01:49.175291 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.175264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"1aecd1250773424f9bf1f4915be730594b54016d533b4f2c75d78cc19e555c50"} Jul 02 23:01:49.175498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.175475 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:49.175613 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.175545 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:49.175613 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.175593 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:49.175958 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.175937 2564 scope.go:117] "RemoveContainer" containerID="2d2fb2f35c3015b7d8852eea2a6bc21953d2f3c53483c5bde3ade822acfe7caf" Jul 02 23:01:49.177381 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.177360 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="bb4c2331cc1979423a02eb792c446c58302e0c7eb718c2cda35db9f2fd801d96" exitCode=0 Jul 02 23:01:49.177459 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.177393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"bb4c2331cc1979423a02eb792c446c58302e0c7eb718c2cda35db9f2fd801d96"} Jul 02 23:01:49.194495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.194329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:49.194701 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.194682 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:01:49.920210 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:49.920182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:49.920480 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:49.920307 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:50.183768 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.183706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:01:50.184185 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.184114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" event={"ID":"29418216-89f4-4344-9e92-14273638d7c4","Type":"ContainerStarted","Data":"3f18ccb54604709b9acffb33d0ef69bccdcdd9b0842c0feedb505a940aa7aad8"} Jul 02 23:01:50.212181 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.212124 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" podStartSLOduration=9.368124401 podStartE2EDuration="30.21210354s" totalImagesPullingTime="20.843979139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:50.211711101 +0000 UTC m=+31.959010214" watchObservedRunningTime="2026-07-02 23:01:50.21210354 +0000 UTC m=+31.959402650" Jul 02 23:01:50.408523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.408491 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnjh8"] Jul 02 23:01:50.408719 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.408605 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:50.408719 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:50.408698 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:50.411971 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.411949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gphg"] Jul 02 23:01:50.412087 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.412076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:50.412192 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:50.412174 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:50.423741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.423713 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdskt"] Jul 02 23:01:50.423871 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:50.423830 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:50.423947 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:50.423930 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:51.187756 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:51.187711 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="b21bdc7cb5e5918f206a418208b6dfdea87e01b662db7eebaf4e7eb722de7bbf" exitCode=0 Jul 02 23:01:51.188229 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:51.187778 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"b21bdc7cb5e5918f206a418208b6dfdea87e01b662db7eebaf4e7eb722de7bbf"} Jul 02 23:01:51.919921 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:51.919893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:51.920112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:51.919990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:51.920112 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:51.919997 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:51.920112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:51.920020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:51.920216 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:51.920126 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:51.920216 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:51.920181 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:52.449052 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:52.449029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:52.449305 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.449160 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:52.449305 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.449218 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:24.449200073 +0000 UTC m=+66.196499167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:01:52.550247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:52.550220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:52.550404 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.550386 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:52.550470 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.550459 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret podName:54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:24.550439298 +0000 UTC m=+66.297738400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret") pod "global-pull-secret-syncer-fdskt" (UID: "54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:01:52.651280 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:52.651250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:52.651416 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.651381 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:01:52.651416 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.651397 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:01:52.651416 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.651405 2564 projected.go:196] Error preparing data for projected volume kube-api-access-d4k97 for pod openshift-network-diagnostics/network-check-target-lnjh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:52.651534 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:52.651451 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97 podName:36a20526-494c-48fe-ac31-0ad2faf1528b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:24.651439079 +0000 UTC m=+66.398738181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4k97" (UniqueName: "kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97") pod "network-check-target-lnjh8" (UID: "36a20526-494c-48fe-ac31-0ad2faf1528b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:01:53.194555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:53.194523 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="8aa0d5596b11754d373c152e6e1a0d9d8d4c5c19d4a45d184dc7a3c9d4177d60" exitCode=0 Jul 02 23:01:53.194555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:53.194557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"8aa0d5596b11754d373c152e6e1a0d9d8d4c5c19d4a45d184dc7a3c9d4177d60"} Jul 02 23:01:53.920797 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:53.920616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:53.921222 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:53.920899 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdskt" podUID="54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3" Jul 02 23:01:53.921222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:53.920636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:53.921222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:53.920613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:53.921222 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:53.920993 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnjh8" podUID="36a20526-494c-48fe-ac31-0ad2faf1528b" Jul 02 23:01:53.921222 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:53.921077 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gphg" podUID="523f04e9-208a-445f-b131-4daf5c7fe32e" Jul 02 23:01:55.546838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.546812 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-1.ec2.internal" event="NodeReady" Jul 02 23:01:55.547201 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.546947 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 23:01:55.585897 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.585816 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:01:55.589849 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.589824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.592345 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.592319 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 23:01:55.592481 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.592357 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mj5r6\"" Jul 02 23:01:55.592742 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.592720 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 23:01:55.592742 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.592741 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 23:01:55.597914 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.597888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 23:01:55.602281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.602260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:01:55.604483 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.604431 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xcdz8"] Jul 02 23:01:55.608155 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.608104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.608299 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.608277 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jdh7g"] Jul 02 23:01:55.610840 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.610750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 23:01:55.610973 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.610872 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6szd7\"" Jul 02 23:01:55.610973 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.610880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 23:01:55.612102 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.612074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.614862 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.614836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 23:01:55.615995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.615328 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 23:01:55.615995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.615546 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 23:01:55.615995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.615581 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qbct9\"" Jul 02 23:01:55.618958 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.618045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xcdz8"] Jul 02 23:01:55.632298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.632270 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jdh7g"] Jul 02 23:01:55.775150 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b17f246-957b-40b6-a2e3-8fed08fa8810-config-volume\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.775150 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17f246-957b-40b6-a2e3-8fed08fa8810-tmp-dir\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b09ddb01-9003-4d81-a884-36bcc54d65ea-cert\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfgw\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tq24\" (UniqueName: \"kubernetes.io/projected/3b17f246-957b-40b6-a2e3-8fed08fa8810-kube-api-access-8tq24\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.775370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4rt\" (UniqueName: \"kubernetes.io/projected/b09ddb01-9003-4d81-a884-36bcc54d65ea-kube-api-access-2r4rt\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.775583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.775567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.876434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b17f246-957b-40b6-a2e3-8fed08fa8810-config-volume\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:55.876528 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17f246-957b-40b6-a2e3-8fed08fa8810-tmp-dir\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:55.876597 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:56.376578199 +0000 UTC m=+38.123877287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b09ddb01-9003-4d81-a884-36bcc54d65ea-cert\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfgw\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.876772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tq24\" (UniqueName: \"kubernetes.io/projected/3b17f246-957b-40b6-a2e3-8fed08fa8810-kube-api-access-8tq24\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17f246-957b-40b6-a2e3-8fed08fa8810-tmp-dir\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.876895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4rt\" (UniqueName: \"kubernetes.io/projected/b09ddb01-9003-4d81-a884-36bcc54d65ea-kube-api-access-2r4rt\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:55.876906 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:55.876920 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:55.876966 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:01:56.376949406 +0000 UTC m=+38.124248505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:01:55.877140 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.877034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b17f246-957b-40b6-a2e3-8fed08fa8810-config-volume\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.877541 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.877368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.877598 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.877577 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.880767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.880742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b09ddb01-9003-4d81-a884-36bcc54d65ea-cert\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.880767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.880748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.880918 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.880748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.886468 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.886446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tq24\" (UniqueName: \"kubernetes.io/projected/3b17f246-957b-40b6-a2e3-8fed08fa8810-kube-api-access-8tq24\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:55.886600 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.886580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.886712 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.886694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4rt\" (UniqueName: \"kubernetes.io/projected/b09ddb01-9003-4d81-a884-36bcc54d65ea-kube-api-access-2r4rt\") pod \"ingress-canary-jdh7g\" (UID: \"b09ddb01-9003-4d81-a884-36bcc54d65ea\") " pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:55.886749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.886729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfgw\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:55.919880 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.919858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:01:55.919994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.919860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:01:55.920048 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.919867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:01:55.922859 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.922841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:01:55.922974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.922895 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 23:01:55.922974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.922842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:01:55.922974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.922841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9lfbh\"" Jul 02 23:01:55.923094 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.923010 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llzj2\"" Jul 02 23:01:55.923094 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.923035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 23:01:55.928940 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:55.928925 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jdh7g" Jul 02 23:01:56.074454 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:56.074422 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jdh7g"] Jul 02 23:01:56.078994 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:01:56.078964 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09ddb01_9003_4d81_a884_36bcc54d65ea.slice/crio-c554c482000aae090a8381c7bbfb66320cad8347e210f9758ecfdfbf2044ab99 WatchSource:0}: Error finding container c554c482000aae090a8381c7bbfb66320cad8347e210f9758ecfdfbf2044ab99: Status 404 returned error can't find the container with id c554c482000aae090a8381c7bbfb66320cad8347e210f9758ecfdfbf2044ab99 Jul 02 23:01:56.202815 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:56.202731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jdh7g" event={"ID":"b09ddb01-9003-4d81-a884-36bcc54d65ea","Type":"ContainerStarted","Data":"c554c482000aae090a8381c7bbfb66320cad8347e210f9758ecfdfbf2044ab99"} Jul 02 23:01:56.379761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:56.379727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:56.379936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:56.379806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:56.379936 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:56.379905 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:01:56.379936 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:56.379931 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:01:56.380113 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:56.379943 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:01:56.380113 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:56.379990 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:01:57.379970223 +0000 UTC m=+39.127269314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:01:56.380113 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:56.380007 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:57.379997902 +0000 UTC m=+39.127296997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:01:57.389028 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:57.388841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:57.389028 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:57.389018 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:01:57.389768 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:57.389042 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:01:57.389768 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:57.389091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:57.389768 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:57.389107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:01:59.389087088 +0000 UTC m=+41.136386178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:01:57.389768 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:57.389178 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:01:57.389768 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:57.389216 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:59.389205392 +0000 UTC m=+41.136504480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:01:59.406684 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:59.406642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:01:59.406741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:59.406775 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:59.406838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.406821552 +0000 UTC m=+45.154120643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:59.406860 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:59.406873 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:01:59.407009 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:01:59.406928 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.406910315 +0000 UTC m=+45.154209426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:02:00.215935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:00.215900 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="abfddf4d409ba8c073593bf7341e868ee7e20614d5ceafadef8f2076fd5c5cfc" exitCode=0 Jul 02 23:02:00.216116 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:00.215986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"abfddf4d409ba8c073593bf7341e868ee7e20614d5ceafadef8f2076fd5c5cfc"} Jul 02 23:02:00.217355 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:00.217335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jdh7g" event={"ID":"b09ddb01-9003-4d81-a884-36bcc54d65ea","Type":"ContainerStarted","Data":"acd3630e3bf12c7e3240bb22c968934ed23e4abab485cf2a52d8c96aef7e26da"} Jul 02 23:02:00.254325 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:00.254283 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jdh7g" podStartSLOduration=1.980717754 podStartE2EDuration="5.254268369s" totalImagesPullingTime="3.273550615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:00.253700224 +0000 UTC m=+42.000999335" watchObservedRunningTime="2026-07-02 23:02:00.254268369 +0000 UTC m=+42.001567456" Jul 02 23:02:01.222094 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.222060 2564 generic.go:356] "Generic (PLEG): container finished" podID="f5645fcf-cc4a-48a1-8ff6-707af076eab3" containerID="702b8af320189ba87ccb07631c77ba9b74cc152b88c752118cf84260ba70d173" exitCode=0 Jul 02 23:02:01.222499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.222148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerDied","Data":"702b8af320189ba87ccb07631c77ba9b74cc152b88c752118cf84260ba70d173"} Jul 02 23:02:01.450844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.450815 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t"] Jul 02 23:02:01.472841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.472772 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866"] Jul 02 23:02:01.472972 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.472907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.475610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.475588 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.475753 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.475595 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 23:02:01.475947 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.475930 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 23:02:01.475989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.475977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.476044 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.476029 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fvv8n\"" Jul 02 23:02:01.494464 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.494443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t"] Jul 02 23:02:01.494567 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.494470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866"] Jul 02 23:02:01.494567 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.494551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.497486 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.497466 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.497599 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.497493 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.497686 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.497598 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qq58r\"" Jul 02 23:02:01.497747 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.497716 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 23:02:01.498830 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.498811 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 23:02:01.520715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzl5r\" (UniqueName: \"kubernetes.io/projected/4ca19cbb-e239-4e78-9852-5a444f05d52e-kube-api-access-kzl5r\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.520790 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27a35549-1d18-41f0-b138-6c604d43e93d-config\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.520790 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27a35549-1d18-41f0-b138-6c604d43e93d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.520863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ca19cbb-e239-4e78-9852-5a444f05d52e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.520863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.520942 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.520887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472jj\" (UniqueName: \"kubernetes.io/projected/27a35549-1d18-41f0-b138-6c604d43e93d-kube-api-access-472jj\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.556086 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.556064 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh"] Jul 02 23:02:01.570473 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.570455 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx"] Jul 02 23:02:01.570590 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.570574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" Jul 02 23:02:01.573370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.573352 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k9bwp\"" Jul 02 23:02:01.573467 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.573357 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.573467 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.573356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.582592 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.582572 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8"] Jul 02 23:02:01.582738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.582720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" Jul 02 23:02:01.585330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.585308 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nzbvv\"" Jul 02 23:02:01.604717 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.604698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7"] Jul 02 23:02:01.604840 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.604825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.607484 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.607468 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.607574 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.607526 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6xkvt\"" Jul 02 23:02:01.607574 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.607554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 23:02:01.607655 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.607598 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.621398 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27a35549-1d18-41f0-b138-6c604d43e93d-config\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.621491 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.621491 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdpmb\" (UniqueName: \"kubernetes.io/projected/bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc-kube-api-access-bdpmb\") pod \"volume-data-source-validator-5d456fdbcd-lh8fh\" (UID: \"bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" Jul 02 23:02:01.621613 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27a35549-1d18-41f0-b138-6c604d43e93d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.621613 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ca19cbb-e239-4e78-9852-5a444f05d52e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.621613 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktj8g\" (UniqueName: \"kubernetes.io/projected/e4e77f71-8b22-4847-af1a-b61316a73fb4-kube-api-access-ktj8g\") pod \"network-check-source-989f8b8dc-srqvx\" (UID: \"e4e77f71-8b22-4847-af1a-b61316a73fb4\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" Jul 02 23:02:01.621821 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.621645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.622052 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.621886 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:01.622128 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.622046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472jj\" (UniqueName: \"kubernetes.io/projected/27a35549-1d18-41f0-b138-6c604d43e93d-kube-api-access-472jj\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.622128 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.622091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzl5r\" (UniqueName: \"kubernetes.io/projected/4ca19cbb-e239-4e78-9852-5a444f05d52e-kube-api-access-kzl5r\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.622128 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.622110 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27a35549-1d18-41f0-b138-6c604d43e93d-config\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.622225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.622131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkhc\" (UniqueName: \"kubernetes.io/projected/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-kube-api-access-zkkhc\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.622225 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.622206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:02.122189188 +0000 UTC m=+43.869488283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:01.622497 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.622479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4ca19cbb-e239-4e78-9852-5a444f05d52e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.623186 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.623167 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c885l"] Jul 02 23:02:01.623283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.623267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.625097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.625080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27a35549-1d18-41f0-b138-6c604d43e93d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.625474 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.625459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 23:02:01.625583 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.625567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 23:02:01.625624 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.625574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4pgcn\"" Jul 02 23:02:01.630816 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.630796 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-472jj\" (UniqueName: \"kubernetes.io/projected/27a35549-1d18-41f0-b138-6c604d43e93d-kube-api-access-472jj\") pod \"service-ca-operator-5d46d9ffd4-tsr2t\" (UID: \"27a35549-1d18-41f0-b138-6c604d43e93d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.631031 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.631015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzl5r\" (UniqueName: \"kubernetes.io/projected/4ca19cbb-e239-4e78-9852-5a444f05d52e-kube-api-access-kzl5r\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:01.637156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637029 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh"] Jul 02 23:02:01.637156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx"] Jul 02 23:02:01.637156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8"] Jul 02 23:02:01.637156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7"] Jul 02 23:02:01.637156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637144 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c885l"] Jul 02 23:02:01.637389 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.637236 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.639629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.639566 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 23:02:01.639629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.639623 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.639816 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.639645 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.639816 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.639777 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8wwgx\"" Jul 02 23:02:01.639964 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.639906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 23:02:01.645209 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.645192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 23:02:01.658784 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.658764 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh"] Jul 02 23:02:01.681050 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.681029 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gf48"] Jul 02 23:02:01.681159 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.681146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.684750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.684499 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 23:02:01.684750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.684737 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 23:02:01.684964 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.684942 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-msscx\"" Jul 02 23:02:01.685281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.685145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.685281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.685165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.693818 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.693801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh"] Jul 02 23:02:01.693891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.693830 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gf48"] Jul 02 23:02:01.693891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.693845 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dfdbf6f99-zd6tw"] Jul 02 23:02:01.693962 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.693906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.696617 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.696597 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 23:02:01.696728 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.696644 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kwsgb\"" Jul 02 23:02:01.696728 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.696708 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.696974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.696958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 23:02:01.697329 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.697315 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.706421 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.706398 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 23:02:01.706997 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.706963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.707377 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.707359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dfdbf6f99-zd6tw"] Jul 02 23:02:01.709680 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.709649 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 23:02:01.709785 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.709744 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 23:02:01.709785 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.709768 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 23:02:01.709941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.709928 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 23:02:01.709987 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.709948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v9m58\"" Jul 02 23:02:01.710167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.710153 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 23:02:01.710211 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.710153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 23:02:01.723317 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.723317 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-trusted-ca\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.723466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-snapshots\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.723466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.723466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-serving-cert\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.723466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5k4j\" (UniqueName: \"kubernetes.io/projected/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-kube-api-access-x5k4j\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.723466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxnd\" (UniqueName: \"kubernetes.io/projected/ebfae3ee-c102-4056-8b81-34df5621fe50-kube-api-access-rpxnd\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkhc\" (UniqueName: \"kubernetes.io/projected/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-kube-api-access-zkkhc\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa7013a9-ec4d-48eb-b682-943af2af102b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdpmb\" (UniqueName: \"kubernetes.io/projected/bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc-kube-api-access-bdpmb\") pod \"volume-data-source-validator-5d456fdbcd-lh8fh\" (UID: \"bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbfjf\" (UniqueName: \"kubernetes.io/projected/55937711-f982-430e-bd43-e29b9d2a4aa0-kube-api-access-lbfjf\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-config\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.723749 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktj8g\" (UniqueName: \"kubernetes.io/projected/e4e77f71-8b22-4847-af1a-b61316a73fb4-kube-api-access-ktj8g\") pod \"network-check-source-989f8b8dc-srqvx\" (UID: \"e4e77f71-8b22-4847-af1a-b61316a73fb4\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-serving-cert\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-tmp\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfs97\" (UniqueName: \"kubernetes.io/projected/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-kube-api-access-cfs97\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfae3ee-c102-4056-8b81-34df5621fe50-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfae3ee-c102-4056-8b81-34df5621fe50-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-stats-auth\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.723991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-default-certificate\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.724009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.724097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.724025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.724360 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.724120 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:02:01.724360 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.724172 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls podName:a80c9d42-762f-48a4-ab2b-0bc974d7dc64 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:02.224159263 +0000 UTC m=+43.971458351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6slt8" (UID: "a80c9d42-762f-48a4-ab2b-0bc974d7dc64") : secret "samples-operator-tls" not found Jul 02 23:02:01.732468 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.732443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdpmb\" (UniqueName: \"kubernetes.io/projected/bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc-kube-api-access-bdpmb\") pod \"volume-data-source-validator-5d456fdbcd-lh8fh\" (UID: \"bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" Jul 02 23:02:01.732566 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.732489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkhc\" (UniqueName: \"kubernetes.io/projected/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-kube-api-access-zkkhc\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:01.732939 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.732921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktj8g\" (UniqueName: \"kubernetes.io/projected/e4e77f71-8b22-4847-af1a-b61316a73fb4-kube-api-access-ktj8g\") pod \"network-check-source-989f8b8dc-srqvx\" (UID: \"e4e77f71-8b22-4847-af1a-b61316a73fb4\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" Jul 02 23:02:01.781652 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.781628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" Jul 02 23:02:01.825100 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-tmp\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825100 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfs97\" (UniqueName: \"kubernetes.io/projected/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-kube-api-access-cfs97\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825296 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfae3ee-c102-4056-8b81-34df5621fe50-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.825296 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfae3ee-c102-4056-8b81-34df5621fe50-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.825296 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-stats-auth\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.825490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-default-certificate\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.825490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-trusted-ca\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.825490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-snapshots\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-serving-cert\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5k4j\" (UniqueName: \"kubernetes.io/projected/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-kube-api-access-x5k4j\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxnd\" (UniqueName: \"kubernetes.io/projected/ebfae3ee-c102-4056-8b81-34df5621fe50-kube-api-access-rpxnd\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-tmp\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa7013a9-ec4d-48eb-b682-943af2af102b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.825748 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbfjf\" (UniqueName: \"kubernetes.io/projected/55937711-f982-430e-bd43-e29b9d2a4aa0-kube-api-access-lbfjf\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-config\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-serving-cert\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.825888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfae3ee-c102-4056-8b81-34df5621fe50-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.826013 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:01.826141 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.826085 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:02.326067828 +0000 UTC m=+44.073366933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:01.826459 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.826270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.826577 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.826551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fa7013a9-ec4d-48eb-b682-943af2af102b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:01.827267 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.826776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.827267 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.826964 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:02.326944474 +0000 UTC m=+44.074243607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:01.827267 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.826966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-config\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.827267 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.827045 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:01.827267 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:01.827083 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:02.327070123 +0000 UTC m=+44.074369243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:01.827731 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.827686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-snapshots\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.827886 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.827860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfae3ee-c102-4056-8b81-34df5621fe50-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.827939 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.827923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-trusted-ca\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.828791 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.828751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-default-certificate\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.828997 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.828977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-serving-cert\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.829048 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.828979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-serving-cert\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.829389 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.829371 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-stats-auth\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.834009 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.833990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfs97\" (UniqueName: \"kubernetes.io/projected/6f482f90-60e7-4c70-806a-7adcd2ba4a9c-kube-api-access-cfs97\") pod \"insights-operator-5c847dcfc4-c885l\" (UID: \"6f482f90-60e7-4c70-806a-7adcd2ba4a9c\") " pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.841805 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.841766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5k4j\" (UniqueName: \"kubernetes.io/projected/76d2e0f3-4208-4c1c-9bd4-486aed561e8b-kube-api-access-x5k4j\") pod \"console-operator-68b757fb67-7gf48\" (UID: \"76d2e0f3-4208-4c1c-9bd4-486aed561e8b\") " pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:01.841889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.841784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxnd\" (UniqueName: \"kubernetes.io/projected/ebfae3ee-c102-4056-8b81-34df5621fe50-kube-api-access-rpxnd\") pod \"kube-storage-version-migrator-operator-846bf668f7-bqksh\" (UID: \"ebfae3ee-c102-4056-8b81-34df5621fe50\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:01.842303 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.842283 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbfjf\" (UniqueName: \"kubernetes.io/projected/55937711-f982-430e-bd43-e29b9d2a4aa0-kube-api-access-lbfjf\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:01.880974 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.880940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" Jul 02 23:02:01.892142 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.892115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" Jul 02 23:02:01.908425 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.908404 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t"] Jul 02 23:02:01.911978 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:01.911636 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a35549_1d18_41f0_b138_6c604d43e93d.slice/crio-17647d7e0142b47db5a85431c0252568cf1e54b535c94bfd451d723cd498b309 WatchSource:0}: Error finding container 17647d7e0142b47db5a85431c0252568cf1e54b535c94bfd451d723cd498b309: Status 404 returned error can't find the container with id 17647d7e0142b47db5a85431c0252568cf1e54b535c94bfd451d723cd498b309 Jul 02 23:02:01.948026 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.947995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" Jul 02 23:02:01.990820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:01.990681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" Jul 02 23:02:02.003081 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.002968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:02.059716 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.059623 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh"] Jul 02 23:02:02.064203 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:02.064151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9e8eb3_9df9_4eb2_a076_47d06dcab7bc.slice/crio-d5185fcc3ba970a3b91075adba6bf25fac7cf69086303c7399827f7ce09f5e71 WatchSource:0}: Error finding container d5185fcc3ba970a3b91075adba6bf25fac7cf69086303c7399827f7ce09f5e71: Status 404 returned error can't find the container with id d5185fcc3ba970a3b91075adba6bf25fac7cf69086303c7399827f7ce09f5e71 Jul 02 23:02:02.086639 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.086589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx"] Jul 02 23:02:02.091918 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:02.091500 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e77f71_8b22_4847_af1a_b61316a73fb4.slice/crio-3d3ca8b9e4c21cb1a74b17f858826ed2170e366a429c9e152fc87a5390257884 WatchSource:0}: Error finding container 3d3ca8b9e4c21cb1a74b17f858826ed2170e366a429c9e152fc87a5390257884: Status 404 returned error can't find the container with id 3d3ca8b9e4c21cb1a74b17f858826ed2170e366a429c9e152fc87a5390257884 Jul 02 23:02:02.129316 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.129281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:02.129547 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.129446 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:02.129547 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.129529 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.129505682 +0000 UTC m=+44.876804774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:02.144742 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.144647 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c885l"] Jul 02 23:02:02.147773 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:02.147732 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f482f90_60e7_4c70_806a_7adcd2ba4a9c.slice/crio-1a8d408670f45431c8f1843e317d43818cf35782caf2a709b6c11ea5c95cd879 WatchSource:0}: Error finding container 1a8d408670f45431c8f1843e317d43818cf35782caf2a709b6c11ea5c95cd879: Status 404 returned error can't find the container with id 1a8d408670f45431c8f1843e317d43818cf35782caf2a709b6c11ea5c95cd879 Jul 02 23:02:02.159151 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.159124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh"] Jul 02 23:02:02.165052 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:02.165025 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfae3ee_c102_4056_8b81_34df5621fe50.slice/crio-0aaaea6ceb3afdd2ae75d8294b51fa7098e1652f471e3a9d633cd46a4edaa391 WatchSource:0}: Error finding container 0aaaea6ceb3afdd2ae75d8294b51fa7098e1652f471e3a9d633cd46a4edaa391: Status 404 returned error can't find the container with id 0aaaea6ceb3afdd2ae75d8294b51fa7098e1652f471e3a9d633cd46a4edaa391 Jul 02 23:02:02.194437 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.194410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gf48"] Jul 02 23:02:02.196976 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:02.196946 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d2e0f3_4208_4c1c_9bd4_486aed561e8b.slice/crio-273e188d7596d2bff4de09761b9ccbc360d6bbaf5c71e1c9e89caac27df7f697 WatchSource:0}: Error finding container 273e188d7596d2bff4de09761b9ccbc360d6bbaf5c71e1c9e89caac27df7f697: Status 404 returned error can't find the container with id 273e188d7596d2bff4de09761b9ccbc360d6bbaf5c71e1c9e89caac27df7f697 Jul 02 23:02:02.224951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.224921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" event={"ID":"76d2e0f3-4208-4c1c-9bd4-486aed561e8b","Type":"ContainerStarted","Data":"273e188d7596d2bff4de09761b9ccbc360d6bbaf5c71e1c9e89caac27df7f697"} Jul 02 23:02:02.226085 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.226063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" event={"ID":"6f482f90-60e7-4c70-806a-7adcd2ba4a9c","Type":"ContainerStarted","Data":"1a8d408670f45431c8f1843e317d43818cf35782caf2a709b6c11ea5c95cd879"} Jul 02 23:02:02.227076 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.227048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" event={"ID":"e4e77f71-8b22-4847-af1a-b61316a73fb4","Type":"ContainerStarted","Data":"3d3ca8b9e4c21cb1a74b17f858826ed2170e366a429c9e152fc87a5390257884"} Jul 02 23:02:02.228017 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.228001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" event={"ID":"bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc","Type":"ContainerStarted","Data":"d5185fcc3ba970a3b91075adba6bf25fac7cf69086303c7399827f7ce09f5e71"} Jul 02 23:02:02.229024 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.229006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" event={"ID":"27a35549-1d18-41f0-b138-6c604d43e93d","Type":"ContainerStarted","Data":"17647d7e0142b47db5a85431c0252568cf1e54b535c94bfd451d723cd498b309"} Jul 02 23:02:02.229772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.229752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:02.229864 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.229851 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:02:02.229930 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.229902 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls podName:a80c9d42-762f-48a4-ab2b-0bc974d7dc64 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.229885775 +0000 UTC m=+44.977184863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6slt8" (UID: "a80c9d42-762f-48a4-ab2b-0bc974d7dc64") : secret "samples-operator-tls" not found Jul 02 23:02:02.230132 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.230112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" event={"ID":"ebfae3ee-c102-4056-8b81-34df5621fe50","Type":"ContainerStarted","Data":"0aaaea6ceb3afdd2ae75d8294b51fa7098e1652f471e3a9d633cd46a4edaa391"} Jul 02 23:02:02.233297 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.233276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" event={"ID":"f5645fcf-cc4a-48a1-8ff6-707af076eab3","Type":"ContainerStarted","Data":"add32008d482c8844d07fb935cf922c4c24f223ecb16a222ee223d82ddd2014e"} Jul 02 23:02:02.254850 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.254766 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gjp5x" podStartSLOduration=8.97457127 podStartE2EDuration="43.25475224s" totalImagesPullingTime="34.28018097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:02.253584879 +0000 UTC m=+44.000883991" watchObservedRunningTime="2026-07-02 23:02:02.25475224 +0000 UTC m=+44.002051351" Jul 02 23:02:02.330465 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.330441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:02.330589 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.330575 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.330559444 +0000 UTC m=+45.077858531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:02.330654 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.330611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:02.330654 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:02.330635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:02.330767 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.330732 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:02.330767 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.330736 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:02.330767 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.330764 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.330755822 +0000 UTC m=+45.078054914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:02.330908 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:02.330787 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:03.330769582 +0000 UTC m=+45.078068684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:03.138842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.138390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:03.150429 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.149823 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:03.150429 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.149914 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:05.149892377 +0000 UTC m=+46.897191482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:03.240615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.240040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:03.240615 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.240224 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:02:03.240615 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.240283 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls podName:a80c9d42-762f-48a4-ab2b-0bc974d7dc64 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:05.240265343 +0000 UTC m=+46.987564436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6slt8" (UID: "a80c9d42-762f-48a4-ab2b-0bc974d7dc64") : secret "samples-operator-tls" not found Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.341392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.341483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.341513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.341637 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:05.341612512 +0000 UTC m=+47.088911613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.341701 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.341946 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:05.341929464 +0000 UTC m=+47.089228556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.341981 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:03.342058 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.342019 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:05.342007712 +0000 UTC m=+47.089306807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.445343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:03.445428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.445567 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.445628 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.445609363 +0000 UTC m=+53.192908453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.446096 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.446113 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:02:03.446278 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:03.446161 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.446145583 +0000 UTC m=+53.193444676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:02:05.164008 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:05.163968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:05.164443 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.164155 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:05.164443 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.164239 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.164215582 +0000 UTC m=+50.911514683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:05.264918 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:05.264876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:05.265105 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.265040 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:02:05.265160 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.265122 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls podName:a80c9d42-762f-48a4-ab2b-0bc974d7dc64 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.265101147 +0000 UTC m=+51.012400239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6slt8" (UID: "a80c9d42-762f-48a4-ab2b-0bc974d7dc64") : secret "samples-operator-tls" not found Jul 02 23:02:05.365519 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:05.365483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:05.365688 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:05.365621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:05.365688 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.365641 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:05.365767 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.365720 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.365706283 +0000 UTC m=+51.113005376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:05.365808 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.365781 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.365763517 +0000 UTC m=+51.113062607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:05.365845 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:05.365810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:05.365914 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.365901 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:05.365948 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:05.365936 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.365928451 +0000 UTC m=+51.113227539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:09.202080 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.202027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:09.202532 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.202171 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:09.202532 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.202255 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.202224659 +0000 UTC m=+58.949523751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:09.257204 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.257178 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/0.log" Jul 02 23:02:09.257390 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.257219 2564 generic.go:356] "Generic (PLEG): container finished" podID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" containerID="c1280f5b1e8af42ab622b2e97029f7fce71c63a2a5b9a1d35ace6b60234c1550" exitCode=255 Jul 02 23:02:09.257390 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.257272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" event={"ID":"76d2e0f3-4208-4c1c-9bd4-486aed561e8b","Type":"ContainerDied","Data":"c1280f5b1e8af42ab622b2e97029f7fce71c63a2a5b9a1d35ace6b60234c1550"} Jul 02 23:02:09.257590 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.257568 2564 scope.go:117] "RemoveContainer" containerID="c1280f5b1e8af42ab622b2e97029f7fce71c63a2a5b9a1d35ace6b60234c1550" Jul 02 23:02:09.260084 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.259627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" event={"ID":"6f482f90-60e7-4c70-806a-7adcd2ba4a9c","Type":"ContainerStarted","Data":"5ab752f1d685dd96ba32479f18533a50df05d16f7eb99358971b0426d5a7ce3c"} Jul 02 23:02:09.261564 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.261543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" event={"ID":"e4e77f71-8b22-4847-af1a-b61316a73fb4","Type":"ContainerStarted","Data":"6b7132af9df0ac47e9c5aeaeec8d9279d56ce916a8e97c7d9d846791dc504d59"} Jul 02 23:02:09.263126 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.263104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" event={"ID":"bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc","Type":"ContainerStarted","Data":"d8b9a27101c46901ebfa1b81e2b531a1cb9cfc76583a646a4bc66e57dab2abc4"} Jul 02 23:02:09.264978 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.264646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" event={"ID":"27a35549-1d18-41f0-b138-6c604d43e93d","Type":"ContainerStarted","Data":"0f668ea5f0d45e5fbaa6e68ed422703d5315337fe817c5e31ddff36a3cdcc7f5"} Jul 02 23:02:09.266527 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.266493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" event={"ID":"ebfae3ee-c102-4056-8b81-34df5621fe50","Type":"ContainerStarted","Data":"bffbccfbac403971be2f0893712367d7341cc1555bcfcee75f9f67806d357b50"} Jul 02 23:02:09.289286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.289240 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" podStartSLOduration=2.156929735 podStartE2EDuration="8.289223837s" totalImagesPullingTime="6.132294102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:09.288569765 +0000 UTC m=+51.035868879" watchObservedRunningTime="2026-07-02 23:02:09.289223837 +0000 UTC m=+51.036522927" Jul 02 23:02:09.308682 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.302948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:09.308682 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.304524 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 23:02:09.311921 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.310920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls podName:a80c9d42-762f-48a4-ab2b-0bc974d7dc64 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.310897899 +0000 UTC m=+59.058197002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6slt8" (UID: "a80c9d42-762f-48a4-ab2b-0bc974d7dc64") : secret "samples-operator-tls" not found Jul 02 23:02:09.330970 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.330524 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" podStartSLOduration=1.9509285539999999 podStartE2EDuration="8.330506831s" totalImagesPullingTime="6.379578277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:09.314943859 +0000 UTC m=+51.062242974" watchObservedRunningTime="2026-07-02 23:02:09.330506831 +0000 UTC m=+51.077805942" Jul 02 23:02:09.331502 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.331468 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-lh8fh" podStartSLOduration=2.128553753 podStartE2EDuration="8.331458734s" totalImagesPullingTime="6.202904981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:09.33083402 +0000 UTC m=+51.078133132" watchObservedRunningTime="2026-07-02 23:02:09.331458734 +0000 UTC m=+51.078757845" Jul 02 23:02:09.348995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.348942 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srqvx" podStartSLOduration=1.833222315 podStartE2EDuration="8.34892648s" totalImagesPullingTime="6.515704165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:09.347727892 +0000 UTC m=+51.095027004" watchObservedRunningTime="2026-07-02 23:02:09.34892648 +0000 UTC m=+51.096225591" Jul 02 23:02:09.371099 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.371061 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" podStartSLOduration=2.226981022 podStartE2EDuration="8.371048137s" totalImagesPullingTime="6.144067115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:09.370250365 +0000 UTC m=+51.117549490" watchObservedRunningTime="2026-07-02 23:02:09.371048137 +0000 UTC m=+51.118347271" Jul 02 23:02:09.406898 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.406857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:09.407505 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.407174 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.407152845 +0000 UTC m=+59.154451939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:09.407746 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.407729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:09.407871 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.407855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:09.408143 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.408121 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:09.408284 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.408178 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:09.408461 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.408270 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.408254737 +0000 UTC m=+59.155553830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:09.408461 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.408376 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.408355713 +0000 UTC m=+59.155654815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:09.450517 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.450479 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dpqxg"] Jul 02 23:02:09.466948 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.466919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.471238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.471209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpqxg"] Jul 02 23:02:09.471495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.471474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 23:02:09.471835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.471816 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jp64q\"" Jul 02 23:02:09.472027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.472010 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 23:02:09.508646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.508611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e818487d-611e-430d-8166-f3328149b88b-data-volume\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.508814 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.508660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.508814 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.508736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e818487d-611e-430d-8166-f3328149b88b-crio-socket\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.508814 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.508795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pggvb\" (UniqueName: \"kubernetes.io/projected/e818487d-611e-430d-8166-f3328149b88b-kube-api-access-pggvb\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.508968 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.508862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609348 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e818487d-611e-430d-8166-f3328149b88b-crio-socket\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pggvb\" (UniqueName: \"kubernetes.io/projected/e818487d-611e-430d-8166-f3328149b88b-kube-api-access-pggvb\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.609429 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.609506 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:10.109485341 +0000 UTC m=+51.856784435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : configmap "kube-rbac-proxy" not found Jul 02 23:02:09.609525 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e818487d-611e-430d-8166-f3328149b88b-crio-socket\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609868 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.609575 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:02:09.609868 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e818487d-611e-430d-8166-f3328149b88b-data-volume\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.609868 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:09.609621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:10.109606569 +0000 UTC m=+51.856905657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:02:09.610014 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.609993 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e818487d-611e-430d-8166-f3328149b88b-data-volume\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:09.618523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:09.618493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pggvb\" (UniqueName: \"kubernetes.io/projected/e818487d-611e-430d-8166-f3328149b88b-kube-api-access-pggvb\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:10.115005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.114969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:10.115175 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:10.115048 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 23:02:10.115175 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:10.115111 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.115094634 +0000 UTC m=+52.862393721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : configmap "kube-rbac-proxy" not found Jul 02 23:02:10.115175 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:10.115125 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:02:10.115175 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:10.115166 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.115153757 +0000 UTC m=+52.862452846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:02:10.115175 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.115056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:10.271542 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.271516 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/1.log" Jul 02 23:02:10.272076 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.272061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/0.log" Jul 02 23:02:10.272127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.272098 2564 generic.go:356] "Generic (PLEG): container finished" podID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" exitCode=255 Jul 02 23:02:10.272225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.272202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" event={"ID":"76d2e0f3-4208-4c1c-9bd4-486aed561e8b","Type":"ContainerDied","Data":"7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1"} Jul 02 23:02:10.272290 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.272268 2564 scope.go:117] "RemoveContainer" containerID="c1280f5b1e8af42ab622b2e97029f7fce71c63a2a5b9a1d35ace6b60234c1550" Jul 02 23:02:10.272496 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:10.272476 2564 scope.go:117] "RemoveContainer" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" Jul 02 23:02:10.272694 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:10.272657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gf48_openshift-console-operator(76d2e0f3-4208-4c1c-9bd4-486aed561e8b)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podUID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" Jul 02 23:02:11.123302 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.123267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:11.123482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.123367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:11.123482 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.123431 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:02:11.123559 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.123506 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:13.123490169 +0000 UTC m=+54.870789257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:02:11.123899 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.123884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e818487d-611e-430d-8166-f3328149b88b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:11.276969 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.276940 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/1.log" Jul 02 23:02:11.277322 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.277284 2564 scope.go:117] "RemoveContainer" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" Jul 02 23:02:11.277465 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.277445 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gf48_openshift-console-operator(76d2e0f3-4208-4c1c-9bd4-486aed561e8b)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podUID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" Jul 02 23:02:11.527091 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.527012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:11.527091 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.527068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:11.527263 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.527216 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 23:02:11.527263 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.527234 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645748fb6-gskm6: secret "image-registry-tls" not found Jul 02 23:02:11.527263 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.527254 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 23:02:11.527350 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.527290 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls podName:2eeef74f-bb39-4814-aff8-bc85d5f7e97d nodeName:}" failed. No retries permitted until 2026-07-02 23:02:27.52727467 +0000 UTC m=+69.274573761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls") pod "image-registry-645748fb6-gskm6" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d") : secret "image-registry-tls" not found Jul 02 23:02:11.527350 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:11.527304 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls podName:3b17f246-957b-40b6-a2e3-8fed08fa8810 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:27.527298299 +0000 UTC m=+69.274597387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls") pod "dns-default-xcdz8" (UID: "3b17f246-957b-40b6-a2e3-8fed08fa8810") : secret "dns-default-metrics-tls" not found Jul 02 23:02:11.667848 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:11.667818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcnrf_b5a3d848-0a79-4a9a-b62c-98a124b5d0be/dns-node-resolver/0.log" Jul 02 23:02:12.003780 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:12.003742 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:12.003948 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:12.003829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:12.279753 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:12.279728 2564 scope.go:117] "RemoveContainer" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" Jul 02 23:02:12.280195 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:12.279931 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gf48_openshift-console-operator(76d2e0f3-4208-4c1c-9bd4-486aed561e8b)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podUID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" Jul 02 23:02:12.468218 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:12.468187 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jx26x_33411e0d-67c4-4133-b062-c6f8d19653fd/node-ca/0.log" Jul 02 23:02:13.069558 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:13.069509 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jdh7g_b09ddb01-9003-4d81-a884-36bcc54d65ea/serve-healthcheck-canary/0.log" Jul 02 23:02:13.140410 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:13.140383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:13.140563 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:13.140537 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:02:13.140627 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:13.140616 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.14059952 +0000 UTC m=+58.887898608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:02:17.175780 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.175739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:17.176250 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.175875 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 23:02:17.176250 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.175934 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls podName:e818487d-611e-430d-8166-f3328149b88b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:25.17592035 +0000 UTC m=+66.923219438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpqxg" (UID: "e818487d-611e-430d-8166-f3328149b88b") : secret "insights-runtime-extractor-tls" not found Jul 02 23:02:17.276565 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.276529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:17.276757 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.276690 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:17.276757 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.276751 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls podName:4ca19cbb-e239-4e78-9852-5a444f05d52e nodeName:}" failed. No retries permitted until 2026-07-02 23:02:33.276734751 +0000 UTC m=+75.024033856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x4866" (UID: "4ca19cbb-e239-4e78-9852-5a444f05d52e") : secret "cluster-monitoring-operator-tls" not found Jul 02 23:02:17.377988 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.377959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:17.380185 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.380157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a80c9d42-762f-48a4-ab2b-0bc974d7dc64-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6slt8\" (UID: \"a80c9d42-762f-48a4-ab2b-0bc974d7dc64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:17.479141 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.479076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:17.479246 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.479157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:17.479246 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.479177 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:33.479163058 +0000 UTC m=+75.226462150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : configmap references non-existent config key: service-ca.crt Jul 02 23:02:17.479246 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.479211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:17.479246 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.479235 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 23:02:17.479424 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.479329 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs podName:55937711-f982-430e-bd43-e29b9d2a4aa0 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:33.47931317 +0000 UTC m=+75.226612266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs") pod "router-default-6dfdbf6f99-zd6tw" (UID: "55937711-f982-430e-bd43-e29b9d2a4aa0") : secret "router-metrics-certs-default" not found Jul 02 23:02:17.479424 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.479361 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 23:02:17.479424 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:17.479405 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert podName:fa7013a9-ec4d-48eb-b682-943af2af102b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:33.479392967 +0000 UTC m=+75.226692055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-hm7g7" (UID: "fa7013a9-ec4d-48eb-b682-943af2af102b") : secret "networking-console-plugin-cert" not found Jul 02 23:02:17.513223 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.513202 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" Jul 02 23:02:17.631176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:17.631150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8"] Jul 02 23:02:18.301011 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:18.300973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" event={"ID":"a80c9d42-762f-48a4-ab2b-0bc974d7dc64","Type":"ContainerStarted","Data":"e0144b9438e8cd5376b1806ff6c457528411aaa37ee8fb37f9928ab1355774d2"} Jul 02 23:02:20.307838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:20.307804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" event={"ID":"a80c9d42-762f-48a4-ab2b-0bc974d7dc64","Type":"ContainerStarted","Data":"96814c96cd4db14ec1f2628063fedbaab421dc7e514e5edc960e9ab783305b32"} Jul 02 23:02:20.308264 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:20.307883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" event={"ID":"a80c9d42-762f-48a4-ab2b-0bc974d7dc64","Type":"ContainerStarted","Data":"64444d34e9787f2bec331df61f487dcd03d7546543f9597fc142296e94767751"} Jul 02 23:02:20.324303 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:20.324255 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6slt8" podStartSLOduration=17.312622689 podStartE2EDuration="19.324242714s" totalImagesPullingTime="2.011620025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:20.324202674 +0000 UTC m=+62.071501785" watchObservedRunningTime="2026-07-02 23:02:20.324242714 +0000 UTC m=+62.071541824" Jul 02 23:02:21.208936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:21.208911 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftr95" Jul 02 23:02:24.538678 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.538632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:02:24.541377 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.541359 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:02:24.549620 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:24.549599 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 23:02:24.549742 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:24.549655 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs podName:523f04e9-208a-445f-b131-4daf5c7fe32e nodeName:}" failed. No retries permitted until 2026-07-02 23:03:28.549638268 +0000 UTC m=+130.296937359 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs") pod "network-metrics-daemon-6gphg" (UID: "523f04e9-208a-445f-b131-4daf5c7fe32e") : secret "metrics-daemon-secret" not found Jul 02 23:02:24.639453 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.639430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:02:24.642052 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.642037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:02:24.652277 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.652253 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3-original-pull-secret\") pod \"global-pull-secret-syncer-fdskt\" (UID: \"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3\") " pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:02:24.740533 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.740509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:02:24.742986 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.742967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4k97\" (UniqueName: \"kubernetes.io/projected/36a20526-494c-48fe-ac31-0ad2faf1528b-kube-api-access-d4k97\") pod \"network-check-target-lnjh8\" (UID: \"36a20526-494c-48fe-ac31-0ad2faf1528b\") " pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:02:24.747721 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.747707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdskt" Jul 02 23:02:24.862423 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.862399 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdskt"] Jul 02 23:02:24.864539 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:24.864519 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e56f1c_74c8_4f3e_b9fe_d0cd04ed28d3.slice/crio-79a6ef0567087d886c5090ccc5d483e98896cc090e0ef5ee2ff197e54de15f97 WatchSource:0}: Error finding container 79a6ef0567087d886c5090ccc5d483e98896cc090e0ef5ee2ff197e54de15f97: Status 404 returned error can't find the container with id 79a6ef0567087d886c5090ccc5d483e98896cc090e0ef5ee2ff197e54de15f97 Jul 02 23:02:24.920142 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:24.920118 2564 scope.go:117] "RemoveContainer" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" Jul 02 23:02:25.037989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.037966 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9lfbh\"" Jul 02 23:02:25.046255 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.046207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:02:25.165296 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.165275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnjh8"] Jul 02 23:02:25.167083 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:25.167062 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a20526_494c_48fe_ac31_0ad2faf1528b.slice/crio-b0fd947c2cb847ca9b38bb6a69e4c005c468167e8e122e9791a246196973e477 WatchSource:0}: Error finding container b0fd947c2cb847ca9b38bb6a69e4c005c468167e8e122e9791a246196973e477: Status 404 returned error can't find the container with id b0fd947c2cb847ca9b38bb6a69e4c005c468167e8e122e9791a246196973e477 Jul 02 23:02:25.244839 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.244811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:25.246839 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.246821 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e818487d-611e-430d-8166-f3328149b88b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpqxg\" (UID: \"e818487d-611e-430d-8166-f3328149b88b\") " pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:25.327133 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.327067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:02:25.327451 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.327436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/1.log" Jul 02 23:02:25.327528 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.327468 2564 generic.go:356] "Generic (PLEG): container finished" podID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" containerID="797937c849f5ada7d7f5d0715f6effbf0d261d662375a9d397b39ddcac5b0600" exitCode=255 Jul 02 23:02:25.327580 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.327553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" event={"ID":"76d2e0f3-4208-4c1c-9bd4-486aed561e8b","Type":"ContainerDied","Data":"797937c849f5ada7d7f5d0715f6effbf0d261d662375a9d397b39ddcac5b0600"} Jul 02 23:02:25.327690 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.327632 2564 scope.go:117] "RemoveContainer" containerID="7f0292ead3e3bf982247d16b612e3412c59acb4de9da5e7d8882a58a4e050ac1" Jul 02 23:02:25.328052 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.328034 2564 scope.go:117] "RemoveContainer" containerID="797937c849f5ada7d7f5d0715f6effbf0d261d662375a9d397b39ddcac5b0600" Jul 02 23:02:25.328237 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:25.328216 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-7gf48_openshift-console-operator(76d2e0f3-4208-4c1c-9bd4-486aed561e8b)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podUID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" Jul 02 23:02:25.329203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.329184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnjh8" event={"ID":"36a20526-494c-48fe-ac31-0ad2faf1528b","Type":"ContainerStarted","Data":"91b5f12a955f5dd2775cb826f828e844acdb164c625bb6842c1ad03f29437d14"} Jul 02 23:02:25.329291 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.329230 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnjh8" event={"ID":"36a20526-494c-48fe-ac31-0ad2faf1528b","Type":"ContainerStarted","Data":"b0fd947c2cb847ca9b38bb6a69e4c005c468167e8e122e9791a246196973e477"} Jul 02 23:02:25.329291 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.329255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:02:25.330323 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.330304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdskt" event={"ID":"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3","Type":"ContainerStarted","Data":"79a6ef0567087d886c5090ccc5d483e98896cc090e0ef5ee2ff197e54de15f97"} Jul 02 23:02:25.362366 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.358986 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lnjh8" podStartSLOduration=66.35896677 podStartE2EDuration="1m6.35896677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:25.357936343 +0000 UTC m=+67.105235452" watchObservedRunningTime="2026-07-02 23:02:25.35896677 +0000 UTC m=+67.106265881" Jul 02 23:02:25.409157 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.409130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jp64q\"" Jul 02 23:02:25.417417 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.417399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpqxg" Jul 02 23:02:25.535040 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:25.535018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpqxg"] Jul 02 23:02:25.537019 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:25.536991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode818487d_611e_430d_8166_f3328149b88b.slice/crio-00963d31ec936df1d09e2fdae5fbff4f553e6e615ce7bd25cf3fccc173293b54 WatchSource:0}: Error finding container 00963d31ec936df1d09e2fdae5fbff4f553e6e615ce7bd25cf3fccc173293b54: Status 404 returned error can't find the container with id 00963d31ec936df1d09e2fdae5fbff4f553e6e615ce7bd25cf3fccc173293b54 Jul 02 23:02:26.340125 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:26.340092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:02:26.347758 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:26.347726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpqxg" event={"ID":"e818487d-611e-430d-8166-f3328149b88b","Type":"ContainerStarted","Data":"00963d31ec936df1d09e2fdae5fbff4f553e6e615ce7bd25cf3fccc173293b54"} Jul 02 23:02:27.569028 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.568984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:27.569486 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.569133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:27.571986 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.571958 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b17f246-957b-40b6-a2e3-8fed08fa8810-metrics-tls\") pod \"dns-default-xcdz8\" (UID: \"3b17f246-957b-40b6-a2e3-8fed08fa8810\") " pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:27.572590 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.572567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"image-registry-645748fb6-gskm6\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:27.703803 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.703764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mj5r6\"" Jul 02 23:02:27.711239 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.711205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:27.725922 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.725883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6szd7\"" Jul 02 23:02:27.733184 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:27.733157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:31.617238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:31.617171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:02:31.621082 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:31.621051 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eeef74f_bb39_4814_aff8_bc85d5f7e97d.slice/crio-2a764ea8a670db6ef2b82a666780dd6af865f99d3c4c9ad8aa03f3c878042f0d WatchSource:0}: Error finding container 2a764ea8a670db6ef2b82a666780dd6af865f99d3c4c9ad8aa03f3c878042f0d: Status 404 returned error can't find the container with id 2a764ea8a670db6ef2b82a666780dd6af865f99d3c4c9ad8aa03f3c878042f0d Jul 02 23:02:31.630841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:31.630817 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xcdz8"] Jul 02 23:02:31.634772 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:31.634740 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b17f246_957b_40b6_a2e3_8fed08fa8810.slice/crio-565ea3312379fe3dc72065b5dc13972d56a024de047e81151cbdc7ccaa0cc4d1 WatchSource:0}: Error finding container 565ea3312379fe3dc72065b5dc13972d56a024de047e81151cbdc7ccaa0cc4d1: Status 404 returned error can't find the container with id 565ea3312379fe3dc72065b5dc13972d56a024de047e81151cbdc7ccaa0cc4d1 Jul 02 23:02:32.003604 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.003570 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:32.003798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.003630 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:32.004033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.004006 2564 scope.go:117] "RemoveContainer" containerID="797937c849f5ada7d7f5d0715f6effbf0d261d662375a9d397b39ddcac5b0600" Jul 02 23:02:32.004273 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:32.004241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-7gf48_openshift-console-operator(76d2e0f3-4208-4c1c-9bd4-486aed561e8b)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podUID="76d2e0f3-4208-4c1c-9bd4-486aed561e8b" Jul 02 23:02:32.371621 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.371583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdskt" event={"ID":"54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3","Type":"ContainerStarted","Data":"712d18dabc3fc43af93b5ff3cd413d23461bd9222d5a97e6b44bc7620218a833"} Jul 02 23:02:32.373802 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.373773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpqxg" event={"ID":"e818487d-611e-430d-8166-f3328149b88b","Type":"ContainerStarted","Data":"66374e0af0c056a03f210836c0e807619b0f71b8a3e394385fff297c7c19fe1d"} Jul 02 23:02:32.373935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.373834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpqxg" event={"ID":"e818487d-611e-430d-8166-f3328149b88b","Type":"ContainerStarted","Data":"c63888cf87e292b5b8f39f12a5325bae57eb09db73b62ae0df1c9a078715cc2c"} Jul 02 23:02:32.375490 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.375463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645748fb6-gskm6" event={"ID":"2eeef74f-bb39-4814-aff8-bc85d5f7e97d","Type":"ContainerStarted","Data":"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff"} Jul 02 23:02:32.375591 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.375513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645748fb6-gskm6" event={"ID":"2eeef74f-bb39-4814-aff8-bc85d5f7e97d","Type":"ContainerStarted","Data":"2a764ea8a670db6ef2b82a666780dd6af865f99d3c4c9ad8aa03f3c878042f0d"} Jul 02 23:02:32.375591 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.375552 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:32.376926 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.376900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcdz8" event={"ID":"3b17f246-957b-40b6-a2e3-8fed08fa8810","Type":"ContainerStarted","Data":"565ea3312379fe3dc72065b5dc13972d56a024de047e81151cbdc7ccaa0cc4d1"} Jul 02 23:02:32.388444 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.388403 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdskt" podStartSLOduration=65.798891881 podStartE2EDuration="1m12.388390311s" totalImagesPullingTime="6.58949843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:32.387613572 +0000 UTC m=+74.134912686" watchObservedRunningTime="2026-07-02 23:02:32.388390311 +0000 UTC m=+74.135689399" Jul 02 23:02:32.406646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:32.406602 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-645748fb6-gskm6" podStartSLOduration=72.406585012 podStartE2EDuration="1m12.406585012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:32.406577021 +0000 UTC m=+74.153876131" watchObservedRunningTime="2026-07-02 23:02:32.406585012 +0000 UTC m=+74.153884123" Jul 02 23:02:33.317295 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.317267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:33.320177 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.320143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ca19cbb-e239-4e78-9852-5a444f05d52e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x4866\" (UID: \"4ca19cbb-e239-4e78-9852-5a444f05d52e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:33.384162 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.384102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcdz8" event={"ID":"3b17f246-957b-40b6-a2e3-8fed08fa8810","Type":"ContainerStarted","Data":"17a263d58696f2a3d9d27d8499842ab5fb736710b06fc618420bae22dc14ba26"} Jul 02 23:02:33.518677 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.518584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:33.518848 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.518692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:33.518848 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.518734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:33.519550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.519521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55937711-f982-430e-bd43-e29b9d2a4aa0-service-ca-bundle\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:33.521843 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.521821 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55937711-f982-430e-bd43-e29b9d2a4aa0-metrics-certs\") pod \"router-default-6dfdbf6f99-zd6tw\" (UID: \"55937711-f982-430e-bd43-e29b9d2a4aa0\") " pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:33.521942 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.521886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa7013a9-ec4d-48eb-b682-943af2af102b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hm7g7\" (UID: \"fa7013a9-ec4d-48eb-b682-943af2af102b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:33.605422 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.605396 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qq58r\"" Jul 02 23:02:33.613570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.613552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" Jul 02 23:02:33.746182 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.746154 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4pgcn\"" Jul 02 23:02:33.754156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.754137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" Jul 02 23:02:33.817442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.817423 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v9m58\"" Jul 02 23:02:33.825235 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:33.825210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:34.390793 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.390756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcdz8" event={"ID":"3b17f246-957b-40b6-a2e3-8fed08fa8810","Type":"ContainerStarted","Data":"702f847a6694c5445cfc5e10ac0815bfa9ccb03b2f6cdc66fe3a047ce8919e1b"} Jul 02 23:02:34.391227 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.390906 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:34.409349 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.409308 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xcdz8" podStartSLOduration=37.843365762 podStartE2EDuration="39.409294026s" totalImagesPullingTime="1.565928264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:34.408149984 +0000 UTC m=+76.155449118" watchObservedRunningTime="2026-07-02 23:02:34.409294026 +0000 UTC m=+76.156593137" Jul 02 23:02:34.739915 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.739849 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866"] Jul 02 23:02:34.744123 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:34.744068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca19cbb_e239_4e78_9852_5a444f05d52e.slice/crio-73da819a871837af392b808b6a43a2eefe9d632438593f392b177e3facc8379e WatchSource:0}: Error finding container 73da819a871837af392b808b6a43a2eefe9d632438593f392b177e3facc8379e: Status 404 returned error can't find the container with id 73da819a871837af392b808b6a43a2eefe9d632438593f392b177e3facc8379e Jul 02 23:02:34.762376 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.762356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dfdbf6f99-zd6tw"] Jul 02 23:02:34.764333 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:34.764298 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55937711_f982_430e_bd43_e29b9d2a4aa0.slice/crio-756eb49a657a4c64fd0be468ec423c276f60cfdd5eb3f73bf69664780400a1dd WatchSource:0}: Error finding container 756eb49a657a4c64fd0be468ec423c276f60cfdd5eb3f73bf69664780400a1dd: Status 404 returned error can't find the container with id 756eb49a657a4c64fd0be468ec423c276f60cfdd5eb3f73bf69664780400a1dd Jul 02 23:02:34.772770 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:34.772747 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7"] Jul 02 23:02:34.776191 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:34.776168 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7013a9_ec4d_48eb_b682_943af2af102b.slice/crio-5bf2975dbd2a9f570dd70542607a06875c1f4aecd28bc27c7e4e25defac779a6 WatchSource:0}: Error finding container 5bf2975dbd2a9f570dd70542607a06875c1f4aecd28bc27c7e4e25defac779a6: Status 404 returned error can't find the container with id 5bf2975dbd2a9f570dd70542607a06875c1f4aecd28bc27c7e4e25defac779a6 Jul 02 23:02:35.396739 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.396700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" event={"ID":"55937711-f982-430e-bd43-e29b9d2a4aa0","Type":"ContainerStarted","Data":"fb1b5db11600f59d324b4980a0340537ad7132406c51bfd73d5f3c001cc9de93"} Jul 02 23:02:35.397206 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.396768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" event={"ID":"55937711-f982-430e-bd43-e29b9d2a4aa0","Type":"ContainerStarted","Data":"756eb49a657a4c64fd0be468ec423c276f60cfdd5eb3f73bf69664780400a1dd"} Jul 02 23:02:35.399172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.399147 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpqxg" event={"ID":"e818487d-611e-430d-8166-f3328149b88b","Type":"ContainerStarted","Data":"49b9656293b816680ab275f09c99b710df64b4aa0588502481e74106b38c905b"} Jul 02 23:02:35.400449 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.400417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" event={"ID":"fa7013a9-ec4d-48eb-b682-943af2af102b","Type":"ContainerStarted","Data":"5bf2975dbd2a9f570dd70542607a06875c1f4aecd28bc27c7e4e25defac779a6"} Jul 02 23:02:35.401696 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.401653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" event={"ID":"4ca19cbb-e239-4e78-9852-5a444f05d52e","Type":"ContainerStarted","Data":"73da819a871837af392b808b6a43a2eefe9d632438593f392b177e3facc8379e"} Jul 02 23:02:35.416707 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.416586 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" podStartSLOduration=34.416567934 podStartE2EDuration="34.416567934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:35.416367337 +0000 UTC m=+77.163666448" watchObservedRunningTime="2026-07-02 23:02:35.416567934 +0000 UTC m=+77.163867046" Jul 02 23:02:35.434645 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.434593 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dpqxg" podStartSLOduration=17.487395175 podStartE2EDuration="26.434573063s" totalImagesPullingTime="8.947177888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:02:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:35.43319022 +0000 UTC m=+77.180489332" watchObservedRunningTime="2026-07-02 23:02:35.434573063 +0000 UTC m=+77.181872174" Jul 02 23:02:35.826032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.825988 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:35.828677 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:35.828634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:36.407745 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:36.407703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" event={"ID":"fa7013a9-ec4d-48eb-b682-943af2af102b","Type":"ContainerStarted","Data":"afa84b994ae8bd3950ede48f58cdc9515da1ddffcd52c2ef490409605b45b49a"} Jul 02 23:02:36.408272 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:36.407870 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:36.409277 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:36.409256 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dfdbf6f99-zd6tw" Jul 02 23:02:36.426212 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:36.426170 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hm7g7" podStartSLOduration=34.332646096 podStartE2EDuration="35.426157819s" totalImagesPullingTime="1.093511723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:36.424426219 +0000 UTC m=+78.171725330" watchObservedRunningTime="2026-07-02 23:02:36.426157819 +0000 UTC m=+78.173456908" Jul 02 23:02:37.018393 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.018359 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45"] Jul 02 23:02:37.053404 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.053372 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45"] Jul 02 23:02:37.053550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.053476 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:37.055909 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.055888 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 23:02:37.056036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.055998 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wkzwl\"" Jul 02 23:02:37.149695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.149645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e7fad82-153f-4cab-b4e0-808df74b4730-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kwj45\" (UID: \"3e7fad82-153f-4cab-b4e0-808df74b4730\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:37.250099 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.250067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e7fad82-153f-4cab-b4e0-808df74b4730-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kwj45\" (UID: \"3e7fad82-153f-4cab-b4e0-808df74b4730\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:37.252411 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.252391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3e7fad82-153f-4cab-b4e0-808df74b4730-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kwj45\" (UID: \"3e7fad82-153f-4cab-b4e0-808df74b4730\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:37.362085 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.362060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:37.413855 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.413832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" event={"ID":"4ca19cbb-e239-4e78-9852-5a444f05d52e","Type":"ContainerStarted","Data":"3900a67ea1c6778fb18528dd6cf913ed3721dffa56e0b02a65fe7638bb775e83"} Jul 02 23:02:37.430010 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.429952 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x4866" podStartSLOduration=34.627323063 podStartE2EDuration="36.429935747s" totalImagesPullingTime="1.802612684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:37.429569816 +0000 UTC m=+79.176868929" watchObservedRunningTime="2026-07-02 23:02:37.429935747 +0000 UTC m=+79.177234857" Jul 02 23:02:37.516422 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:37.516394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45"] Jul 02 23:02:37.519343 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:37.519314 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7fad82_153f_4cab_b4e0_808df74b4730.slice/crio-0190a8117e451cedda558a2b9820996ec8316a395d60be2d25d82895a13b9f02 WatchSource:0}: Error finding container 0190a8117e451cedda558a2b9820996ec8316a395d60be2d25d82895a13b9f02: Status 404 returned error can't find the container with id 0190a8117e451cedda558a2b9820996ec8316a395d60be2d25d82895a13b9f02 Jul 02 23:02:38.418786 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:38.418742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" event={"ID":"3e7fad82-153f-4cab-b4e0-808df74b4730","Type":"ContainerStarted","Data":"0190a8117e451cedda558a2b9820996ec8316a395d60be2d25d82895a13b9f02"} Jul 02 23:02:39.427991 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:39.427955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" event={"ID":"3e7fad82-153f-4cab-b4e0-808df74b4730","Type":"ContainerStarted","Data":"10b00bb2454a8b7c9b7ee9cf6295ef1bc2d163fb5f39e70420bd4da8662f6ddd"} Jul 02 23:02:39.428426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:39.428050 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:39.432729 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:39.432708 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" Jul 02 23:02:39.444516 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:39.444468 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kwj45" podStartSLOduration=1.039733772 podStartE2EDuration="2.444454588s" totalImagesPullingTime="1.404720816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:39.443407215 +0000 UTC m=+81.190706407" watchObservedRunningTime="2026-07-02 23:02:39.444454588 +0000 UTC m=+81.191753697" Jul 02 23:02:40.095498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.095462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf"] Jul 02 23:02:40.103452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.103428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.108479 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.108453 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 23:02:40.108603 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.108483 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 23:02:40.110033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.109706 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 23:02:40.110183 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.110159 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dgz8l\"" Jul 02 23:02:40.111686 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.111650 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf"] Jul 02 23:02:40.176537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.176506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc96c-7517-4304-8835-937e726bb705-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.176689 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.176544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.176689 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.176570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.176810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.176704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwgs\" (UniqueName: \"kubernetes.io/projected/b8fdc96c-7517-4304-8835-937e726bb705-kube-api-access-7mwgs\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.277881 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.277853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwgs\" (UniqueName: \"kubernetes.io/projected/b8fdc96c-7517-4304-8835-937e726bb705-kube-api-access-7mwgs\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.278008 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.277993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc96c-7517-4304-8835-937e726bb705-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.278065 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.278023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.278065 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.278044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.278579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.278550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc96c-7517-4304-8835-937e726bb705-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.280419 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.280399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.280499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.280486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b8fdc96c-7517-4304-8835-937e726bb705-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.286012 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.285990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwgs\" (UniqueName: \"kubernetes.io/projected/b8fdc96c-7517-4304-8835-937e726bb705-kube-api-access-7mwgs\") pod \"prometheus-operator-567f7b8b7c-ks5zf\" (UID: \"b8fdc96c-7517-4304-8835-937e726bb705\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.412795 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.412745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" Jul 02 23:02:40.551694 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:40.551588 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf"] Jul 02 23:02:40.554149 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:40.554121 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fdc96c_7517_4304_8835_937e726bb705.slice/crio-b41d1d282406b717f66bbcf2706b3c9fb5aa8763277f53d816ec0a8317b96761 WatchSource:0}: Error finding container b41d1d282406b717f66bbcf2706b3c9fb5aa8763277f53d816ec0a8317b96761: Status 404 returned error can't find the container with id b41d1d282406b717f66bbcf2706b3c9fb5aa8763277f53d816ec0a8317b96761 Jul 02 23:02:41.436862 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:41.436737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" event={"ID":"b8fdc96c-7517-4304-8835-937e726bb705","Type":"ContainerStarted","Data":"b41d1d282406b717f66bbcf2706b3c9fb5aa8763277f53d816ec0a8317b96761"} Jul 02 23:02:42.441888 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:42.441854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" event={"ID":"b8fdc96c-7517-4304-8835-937e726bb705","Type":"ContainerStarted","Data":"205196e88e06dafac96bd9a14e6915af18650075c5f854b8ec2c70924cd99397"} Jul 02 23:02:42.442247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:42.441921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" event={"ID":"b8fdc96c-7517-4304-8835-937e726bb705","Type":"ContainerStarted","Data":"44c39c1aec74f7385f8a63fb154fc26c6b09af8c69fecbe9367ee13910dbf222"} Jul 02 23:02:42.459501 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:42.459457 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-ks5zf" podStartSLOduration=1.057041017 podStartE2EDuration="2.459441644s" totalImagesPullingTime="1.402400627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:42.458177151 +0000 UTC m=+84.205476261" watchObservedRunningTime="2026-07-02 23:02:42.459441644 +0000 UTC m=+84.206740754" Jul 02 23:02:44.404483 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.404453 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xcdz8" Jul 02 23:02:44.499556 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.499525 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vxw6k"] Jul 02 23:02:44.504093 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.504077 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.506552 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.506533 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 23:02:44.507018 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.507000 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 23:02:44.507111 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.507071 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-25f5f\"" Jul 02 23:02:44.507172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.507154 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 23:02:44.607872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.607836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzxl\" (UniqueName: \"kubernetes.io/projected/4b1ff81e-5faf-41ce-8d11-d236c4121130-kube-api-access-8bzxl\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.607872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.607877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-root\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.607954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-sys\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-metrics-client-ca\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-wtmp\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-textfile\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.608167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.608149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709272 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzxl\" (UniqueName: \"kubernetes.io/projected/4b1ff81e-5faf-41ce-8d11-d236c4121130-kube-api-access-8bzxl\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709272 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-root\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-sys\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-metrics-client-ca\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-wtmp\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-textfile\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709395 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-root\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-sys\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709842 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:44.709487 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 23:02:44.709842 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:44.709567 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls podName:4b1ff81e-5faf-41ce-8d11-d236c4121130 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:45.209548982 +0000 UTC m=+86.956848083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls") pod "node-exporter-vxw6k" (UID: "4b1ff81e-5faf-41ce-8d11-d236c4121130") : secret "node-exporter-tls" not found Jul 02 23:02:44.709842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-wtmp\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.709842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.709734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-textfile\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.710032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.710012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.710069 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.710012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b1ff81e-5faf-41ce-8d11-d236c4121130-metrics-client-ca\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.711712 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.711695 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:44.718554 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:44.718532 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzxl\" (UniqueName: \"kubernetes.io/projected/4b1ff81e-5faf-41ce-8d11-d236c4121130-kube-api-access-8bzxl\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:45.213211 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:45.213176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:45.213372 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:45.213313 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 23:02:45.213414 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:02:45.213383 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls podName:4b1ff81e-5faf-41ce-8d11-d236c4121130 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:46.213365551 +0000 UTC m=+87.960664639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls") pod "node-exporter-vxw6k" (UID: "4b1ff81e-5faf-41ce-8d11-d236c4121130") : secret "node-exporter-tls" not found Jul 02 23:02:45.920330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:45.920304 2564 scope.go:117] "RemoveContainer" containerID="797937c849f5ada7d7f5d0715f6effbf0d261d662375a9d397b39ddcac5b0600" Jul 02 23:02:46.221858 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.221779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:46.224226 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.224199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b1ff81e-5faf-41ce-8d11-d236c4121130-node-exporter-tls\") pod \"node-exporter-vxw6k\" (UID: \"4b1ff81e-5faf-41ce-8d11-d236c4121130\") " pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:46.317370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.317343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vxw6k" Jul 02 23:02:46.329511 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:46.329481 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1ff81e_5faf_41ce_8d11_d236c4121130.slice/crio-8cce32def344c9d88ead2c1eac889a7f85bf9a70cf0d0ffe2422bdbf6deb679a WatchSource:0}: Error finding container 8cce32def344c9d88ead2c1eac889a7f85bf9a70cf0d0ffe2422bdbf6deb679a: Status 404 returned error can't find the container with id 8cce32def344c9d88ead2c1eac889a7f85bf9a70cf0d0ffe2422bdbf6deb679a Jul 02 23:02:46.458199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.458170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxw6k" event={"ID":"4b1ff81e-5faf-41ce-8d11-d236c4121130","Type":"ContainerStarted","Data":"8cce32def344c9d88ead2c1eac889a7f85bf9a70cf0d0ffe2422bdbf6deb679a"} Jul 02 23:02:46.460375 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.460356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:02:46.460498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.460412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" event={"ID":"76d2e0f3-4208-4c1c-9bd4-486aed561e8b","Type":"ContainerStarted","Data":"c81ca68c489ad2c4147323e17e206c42701f16e3e88298aeb9077518e67e6349"} Jul 02 23:02:46.460679 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.460645 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:46.482479 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.482400 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" podStartSLOduration=39.387659576 podStartE2EDuration="45.482387702s" totalImagesPullingTime="6.094728126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:46.481199359 +0000 UTC m=+88.228498472" watchObservedRunningTime="2026-07-02 23:02:46.482387702 +0000 UTC m=+88.229686811" Jul 02 23:02:46.647370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:46.647344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-7gf48" Jul 02 23:02:48.471199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:48.471171 2564 generic.go:356] "Generic (PLEG): container finished" podID="4b1ff81e-5faf-41ce-8d11-d236c4121130" containerID="bfd3ee1cdea715a190da43e63770e6e4235629d0972db8b14281cb8f9c6bf5ca" exitCode=0 Jul 02 23:02:48.471553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:48.471240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxw6k" event={"ID":"4b1ff81e-5faf-41ce-8d11-d236c4121130","Type":"ContainerDied","Data":"bfd3ee1cdea715a190da43e63770e6e4235629d0972db8b14281cb8f9c6bf5ca"} Jul 02 23:02:49.242536 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.242502 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx"] Jul 02 23:02:49.245706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.245686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.248272 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.248248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nlwr8\"" Jul 02 23:02:49.248379 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.248362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 23:02:49.254765 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.254744 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx"] Jul 02 23:02:49.348957 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.348928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a29dfc19-041d-4d00-9b34-8abd774c343a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.349072 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.348987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzsnd\" (UniqueName: \"kubernetes.io/projected/a29dfc19-041d-4d00-9b34-8abd774c343a-kube-api-access-rzsnd\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.449531 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.449502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzsnd\" (UniqueName: \"kubernetes.io/projected/a29dfc19-041d-4d00-9b34-8abd774c343a-kube-api-access-rzsnd\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.449646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.449586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a29dfc19-041d-4d00-9b34-8abd774c343a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.451975 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.451954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a29dfc19-041d-4d00-9b34-8abd774c343a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.458774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.458753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzsnd\" (UniqueName: \"kubernetes.io/projected/a29dfc19-041d-4d00-9b34-8abd774c343a-kube-api-access-rzsnd\") pod \"monitoring-plugin-d5dcff7cf-ttpnx\" (UID: \"a29dfc19-041d-4d00-9b34-8abd774c343a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.477204 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.477176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxw6k" event={"ID":"4b1ff81e-5faf-41ce-8d11-d236c4121130","Type":"ContainerStarted","Data":"a4daa2f402a5c736c7e312646e09ad542b611e8b73b9b31313d4f9d296da27a4"} Jul 02 23:02:49.477575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.477237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxw6k" event={"ID":"4b1ff81e-5faf-41ce-8d11-d236c4121130","Type":"ContainerStarted","Data":"60de4d7aca8f6610bf8f1d1385e84f5d64621b31c23e18d522ff555afb7a7d84"} Jul 02 23:02:49.499929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.499858 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vxw6k" podStartSLOduration=4.341702125 podStartE2EDuration="5.499843283s" totalImagesPullingTime="1.094583682s" totalInitContainerRuntime="63.557476ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:49.498112957 +0000 UTC m=+91.245412067" watchObservedRunningTime="2026-07-02 23:02:49.499843283 +0000 UTC m=+91.247142392" Jul 02 23:02:49.556916 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.556891 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:49.682117 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:49.682093 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx"] Jul 02 23:02:49.685191 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:49.685132 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29dfc19_041d_4d00_9b34_8abd774c343a.slice/crio-d028497ddc5e9976600ba3b69c7c8d2e5a71158deaef93f5fa1c3ccd62ce4141 WatchSource:0}: Error finding container d028497ddc5e9976600ba3b69c7c8d2e5a71158deaef93f5fa1c3ccd62ce4141: Status 404 returned error can't find the container with id d028497ddc5e9976600ba3b69c7c8d2e5a71158deaef93f5fa1c3ccd62ce4141 Jul 02 23:02:50.487263 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.487228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" event={"ID":"a29dfc19-041d-4d00-9b34-8abd774c343a","Type":"ContainerStarted","Data":"d028497ddc5e9976600ba3b69c7c8d2e5a71158deaef93f5fa1c3ccd62ce4141"} Jul 02 23:02:50.733526 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.731333 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:02:50.735805 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.735780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.741883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.742072 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.742245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.742523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.742815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.742857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.743060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e90a5n52pkm6r\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.743189 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwgrz\"" Jul 02 23:02:50.743733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.743373 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 23:02:50.746130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.744628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 23:02:50.746130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.744838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 23:02:50.746130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.745396 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 23:02:50.746130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.745750 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 23:02:50.746377 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.746261 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 23:02:50.746377 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.746284 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 23:02:50.748809 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.748355 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 23:02:50.749786 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.749763 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 23:02:50.755518 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.755487 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:02:50.859753 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.859753 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.859999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.860477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.860464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpw87\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961314 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961314 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.961524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpw87\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.961748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.962111 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.962248 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.962447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.962507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.962477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965497 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.965995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.965846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.966342 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.966091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.966342 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.966203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.967901 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.967869 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.968126 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.968102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.971309 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.971266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.971887 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.971834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.971887 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.971847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.972804 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.972726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.972804 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.972729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.972804 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.972781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.973193 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.973152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.974622 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.973488 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.975407 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.975357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:50.979252 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:50.979220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpw87\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87\") pod \"prometheus-k8s-0\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:51.052929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.052896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:02:51.336864 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.336842 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:02:51.338381 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:02:51.338358 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1229a916_3989_4d6c_bd13_b6cf40afe210.slice/crio-01e583a1157b0354b1be2dfb0f4a487c8edcc08223eb614a428d988cf3e27870 WatchSource:0}: Error finding container 01e583a1157b0354b1be2dfb0f4a487c8edcc08223eb614a428d988cf3e27870: Status 404 returned error can't find the container with id 01e583a1157b0354b1be2dfb0f4a487c8edcc08223eb614a428d988cf3e27870 Jul 02 23:02:51.492818 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.492786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"01e583a1157b0354b1be2dfb0f4a487c8edcc08223eb614a428d988cf3e27870"} Jul 02 23:02:51.494376 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.494354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" event={"ID":"a29dfc19-041d-4d00-9b34-8abd774c343a","Type":"ContainerStarted","Data":"72e8e66b8da591e5a6aa245b5824c70467159bab6a6ca80042acdc6d140d5f82"} Jul 02 23:02:51.494676 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.494641 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:51.499038 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.499020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" Jul 02 23:02:51.512955 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:51.512907 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-ttpnx" podStartSLOduration=0.952605373 podStartE2EDuration="2.512893343s" totalImagesPullingTime="1.56028797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:51.512315654 +0000 UTC m=+93.259614765" watchObservedRunningTime="2026-07-02 23:02:51.512893343 +0000 UTC m=+93.260192452" Jul 02 23:02:52.500322 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:52.500289 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" exitCode=0 Jul 02 23:02:52.500677 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:52.500370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} Jul 02 23:02:53.389121 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:53.389091 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:02:54.829810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:54.829775 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:02:56.350706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:56.350656 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lnjh8" Jul 02 23:02:56.520499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:56.520467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} Jul 02 23:02:56.520643 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:56.520528 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} Jul 02 23:02:58.532264 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:58.532224 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} Jul 02 23:02:58.532646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:58.532324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} Jul 02 23:02:58.532646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:58.532357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} Jul 02 23:02:58.532646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:58.532383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerStarted","Data":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} Jul 02 23:02:58.558469 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:02:58.558423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.018632072 podStartE2EDuration="8.558407121s" totalImagesPullingTime="6.521329469s" totalInitContainerRuntime="18.44558ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:58.556167859 +0000 UTC m=+100.303466983" watchObservedRunningTime="2026-07-02 23:02:58.558407121 +0000 UTC m=+100.305706230" Jul 02 23:03:01.053017 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:01.052983 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:03:19.619581 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.619549 2564 generic.go:356] "Generic (PLEG): container finished" podID="27a35549-1d18-41f0-b138-6c604d43e93d" containerID="0f668ea5f0d45e5fbaa6e68ed422703d5315337fe817c5e31ddff36a3cdcc7f5" exitCode=0 Jul 02 23:03:19.619991 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.619619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" event={"ID":"27a35549-1d18-41f0-b138-6c604d43e93d","Type":"ContainerDied","Data":"0f668ea5f0d45e5fbaa6e68ed422703d5315337fe817c5e31ddff36a3cdcc7f5"} Jul 02 23:03:19.619991 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.619926 2564 scope.go:117] "RemoveContainer" containerID="0f668ea5f0d45e5fbaa6e68ed422703d5315337fe817c5e31ddff36a3cdcc7f5" Jul 02 23:03:19.621222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.621205 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f482f90-60e7-4c70-806a-7adcd2ba4a9c" containerID="5ab752f1d685dd96ba32479f18533a50df05d16f7eb99358971b0426d5a7ce3c" exitCode=0 Jul 02 23:03:19.621289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.621272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" event={"ID":"6f482f90-60e7-4c70-806a-7adcd2ba4a9c","Type":"ContainerDied","Data":"5ab752f1d685dd96ba32479f18533a50df05d16f7eb99358971b0426d5a7ce3c"} Jul 02 23:03:19.621553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.621540 2564 scope.go:117] "RemoveContainer" containerID="5ab752f1d685dd96ba32479f18533a50df05d16f7eb99358971b0426d5a7ce3c" Jul 02 23:03:19.858218 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:19.858167 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-645748fb6-gskm6" podUID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" containerName="registry" containerID="cri-o://fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff" gracePeriod=30 Jul 02 23:03:20.120146 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.120125 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:03:20.217759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217680 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znfgw\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.217759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217726 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.217759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217794 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217863 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217915 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217950 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.217981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") pod \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\" (UID: \"2eeef74f-bb39-4814-aff8-bc85d5f7e97d\") " Jul 02 23:03:20.218243 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.218126 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:03:20.218295 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.218254 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-certificates\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.218733 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.218687 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:03:20.220620 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.220586 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:03:20.220917 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.220854 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw" (OuterVolumeSpecName: "kube-api-access-znfgw") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "kube-api-access-znfgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:03:20.221007 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.220972 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:03:20.221270 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.221230 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:03:20.221457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.221359 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:03:20.229487 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.229460 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2eeef74f-bb39-4814-aff8-bc85d5f7e97d" (UID: "2eeef74f-bb39-4814-aff8-bc85d5f7e97d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:03:20.319455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319433 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-image-registry-private-configuration\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319453 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-ca-trust-extracted\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319614 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319464 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-bound-sa-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319614 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319471 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-trusted-ca\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319614 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319479 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-registry-tls\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319614 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319486 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znfgw\" (UniqueName: \"kubernetes.io/projected/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-kube-api-access-znfgw\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.319614 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.319494 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2eeef74f-bb39-4814-aff8-bc85d5f7e97d-installation-pull-secrets\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:03:20.627164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.627131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c885l" event={"ID":"6f482f90-60e7-4c70-806a-7adcd2ba4a9c","Type":"ContainerStarted","Data":"83e11c7a85376ad40db48a8ab8e91da253026388c01b5c9855187ad74752e0e6"} Jul 02 23:03:20.628382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.628358 2564 generic.go:356] "Generic (PLEG): container finished" podID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" containerID="fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff" exitCode=0 Jul 02 23:03:20.628503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.628403 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645748fb6-gskm6" Jul 02 23:03:20.628503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.628445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645748fb6-gskm6" event={"ID":"2eeef74f-bb39-4814-aff8-bc85d5f7e97d","Type":"ContainerDied","Data":"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff"} Jul 02 23:03:20.628503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.628490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-645748fb6-gskm6" event={"ID":"2eeef74f-bb39-4814-aff8-bc85d5f7e97d","Type":"ContainerDied","Data":"2a764ea8a670db6ef2b82a666780dd6af865f99d3c4c9ad8aa03f3c878042f0d"} Jul 02 23:03:20.628655 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.628518 2564 scope.go:117] "RemoveContainer" containerID="fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff" Jul 02 23:03:20.630338 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.630318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tsr2t" event={"ID":"27a35549-1d18-41f0-b138-6c604d43e93d","Type":"ContainerStarted","Data":"b226638da6cd1e475c9515efa04445a24e45eef9a22dfc20e8540c0e023085c9"} Jul 02 23:03:20.638310 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.638287 2564 scope.go:117] "RemoveContainer" containerID="fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff" Jul 02 23:03:20.638563 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:03:20.638546 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff\": container with ID starting with fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff not found: ID does not exist" containerID="fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff" Jul 02 23:03:20.638625 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.638568 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff"} err="failed to get container status \"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff\": rpc error: code = NotFound desc = could not find container \"fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff\": container with ID starting with fab1a28ba398db38c52677527c05bf0e24b645cb2f0ace72c0930d82028b4dff not found: ID does not exist" Jul 02 23:03:20.678491 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.678466 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:03:20.686604 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.686582 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-645748fb6-gskm6"] Jul 02 23:03:20.925205 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:20.925138 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" path="/var/lib/kubelet/pods/2eeef74f-bb39-4814-aff8-bc85d5f7e97d/volumes" Jul 02 23:03:28.584012 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:28.583978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:03:28.586228 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:28.586208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/523f04e9-208a-445f-b131-4daf5c7fe32e-metrics-certs\") pod \"network-metrics-daemon-6gphg\" (UID: \"523f04e9-208a-445f-b131-4daf5c7fe32e\") " pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:03:28.632252 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:28.632227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llzj2\"" Jul 02 23:03:28.640553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:28.640532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gphg" Jul 02 23:03:28.810627 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:28.810596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gphg"] Jul 02 23:03:28.812770 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:03:28.812748 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523f04e9_208a_445f_b131_4daf5c7fe32e.slice/crio-723295cf93511c1b3dbceab4439c941a8c2784dab62acbf0da7a070414bea7a9 WatchSource:0}: Error finding container 723295cf93511c1b3dbceab4439c941a8c2784dab62acbf0da7a070414bea7a9: Status 404 returned error can't find the container with id 723295cf93511c1b3dbceab4439c941a8c2784dab62acbf0da7a070414bea7a9 Jul 02 23:03:29.669411 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:29.669361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gphg" event={"ID":"523f04e9-208a-445f-b131-4daf5c7fe32e","Type":"ContainerStarted","Data":"723295cf93511c1b3dbceab4439c941a8c2784dab62acbf0da7a070414bea7a9"} Jul 02 23:03:30.675217 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.675189 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebfae3ee-c102-4056-8b81-34df5621fe50" containerID="bffbccfbac403971be2f0893712367d7341cc1555bcfcee75f9f67806d357b50" exitCode=0 Jul 02 23:03:30.675607 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.675271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" event={"ID":"ebfae3ee-c102-4056-8b81-34df5621fe50","Type":"ContainerDied","Data":"bffbccfbac403971be2f0893712367d7341cc1555bcfcee75f9f67806d357b50"} Jul 02 23:03:30.675607 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.675592 2564 scope.go:117] "RemoveContainer" containerID="bffbccfbac403971be2f0893712367d7341cc1555bcfcee75f9f67806d357b50" Jul 02 23:03:30.677251 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.677226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gphg" event={"ID":"523f04e9-208a-445f-b131-4daf5c7fe32e","Type":"ContainerStarted","Data":"66b8024c35e1cc100b60721c1cf36faf3c27505ff4d2ca639fbf624f4a332520"} Jul 02 23:03:30.677330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.677278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gphg" event={"ID":"523f04e9-208a-445f-b131-4daf5c7fe32e","Type":"ContainerStarted","Data":"176510443e8b2f346f9191dded4b2584a5d585da48131ff884afbae55b6a0cc9"} Jul 02 23:03:30.714005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:30.713946 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6gphg" podStartSLOduration=130.470389461 podStartE2EDuration="2m11.713928174s" totalImagesPullingTime="1.243538713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:03:30.712324325 +0000 UTC m=+132.459623435" watchObservedRunningTime="2026-07-02 23:03:30.713928174 +0000 UTC m=+132.461227285" Jul 02 23:03:31.683742 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:31.683707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bqksh" event={"ID":"ebfae3ee-c102-4056-8b81-34df5621fe50","Type":"ContainerStarted","Data":"9781141d7e0d305e373c11ef40f10b7a5590fc65ef662f9941953e205dd63c8b"} Jul 02 23:03:51.053484 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:51.053452 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:03:51.068793 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:51.068769 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:03:51.774646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:03:51.774621 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.093905 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.093870 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:09.094455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094319 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="prometheus" containerID="cri-o://0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" gracePeriod=600 Jul 02 23:04:09.094455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094342 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="thanos-sidecar" containerID="cri-o://81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" gracePeriod=600 Jul 02 23:04:09.094455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094333 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-thanos" containerID="cri-o://93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" gracePeriod=600 Jul 02 23:04:09.094455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094374 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="config-reloader" containerID="cri-o://fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" gracePeriod=600 Jul 02 23:04:09.094741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094457 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy" containerID="cri-o://12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" gracePeriod=600 Jul 02 23:04:09.094741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.094473 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-web" containerID="cri-o://ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" gracePeriod=600 Jul 02 23:04:09.347855 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.347801 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.488960 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.488930 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.488968 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.488987 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489040 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489058 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489079 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489099 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpw87\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489134 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489165 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489240 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489265 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489309 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489347 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489380 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489407 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489434 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489463 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489474 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.489929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489507 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file\") pod \"1229a916-3989-4d6c-bd13-b6cf40afe210\" (UID: \"1229a916-3989-4d6c-bd13-b6cf40afe210\") " Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489716 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489833 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489855 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489871 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.489987 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.490616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.490160 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:04:09.491281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.491254 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.491479 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.491397 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.492366 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.492328 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out" (OuterVolumeSpecName: "config-out") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:04:09.492972 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.492928 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.493095 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.492964 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:04:09.493095 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493029 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.493227 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493198 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:04:09.493329 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493310 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.493728 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493579 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.493728 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493614 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config" (OuterVolumeSpecName: "config") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.493728 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493693 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87" (OuterVolumeSpecName: "kube-api-access-dpw87") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "kube-api-access-dpw87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:04:09.493935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.493883 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.494302 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.494279 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.494627 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.494601 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.503600 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.503576 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config" (OuterVolumeSpecName: "web-config") pod "1229a916-3989-4d6c-bd13-b6cf40afe210" (UID: "1229a916-3989-4d6c-bd13-b6cf40afe210"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:04:09.590483 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590461 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590483 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590480 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-config\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590489 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590498 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590507 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590515 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-db\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590522 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1229a916-3989-4d6c-bd13-b6cf40afe210-config-out\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590529 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-tls-assets\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590536 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpw87\" (UniqueName: \"kubernetes.io/projected/1229a916-3989-4d6c-bd13-b6cf40afe210-kube-api-access-dpw87\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590545 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-web-config\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590553 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590560 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-kube-rbac-proxy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590569 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590576 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1229a916-3989-4d6c-bd13-b6cf40afe210-configmap-metrics-client-ca\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590584 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590592 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-metrics-client-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.590595 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.590599 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1229a916-3989-4d6c-bd13-b6cf40afe210-secret-grpc-tls\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:04:09.833143 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833111 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" exitCode=0 Jul 02 23:04:09.833143 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833143 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" exitCode=0 Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833152 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" exitCode=0 Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833161 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" exitCode=0 Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833169 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" exitCode=0 Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833178 2564 generic.go:356] "Generic (PLEG): container finished" podID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" exitCode=0 Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833212 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} Jul 02 23:04:09.833336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} Jul 02 23:04:09.833611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} Jul 02 23:04:09.833611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} Jul 02 23:04:09.833611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1229a916-3989-4d6c-bd13-b6cf40afe210","Type":"ContainerDied","Data":"01e583a1157b0354b1be2dfb0f4a487c8edcc08223eb614a428d988cf3e27870"} Jul 02 23:04:09.833611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.833371 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.841809 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.841789 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.848938 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.848923 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.855314 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.855293 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.858294 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.858269 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:09.862581 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.862559 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:09.863207 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.863192 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.869488 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.869471 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.876277 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.876261 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.882516 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.882501 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.882771 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.882754 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.882832 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.882780 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.882832 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.882805 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.883054 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.883039 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.883095 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883060 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.883095 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883073 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.883294 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.883278 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.883334 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883300 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.883334 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883317 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.883550 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.883533 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.883587 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883555 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.883587 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883569 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.883815 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.883799 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.883889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883822 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.883889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.883840 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.884101 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.884086 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.884143 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884105 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.884143 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884120 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.884329 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:04:09.884312 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.884397 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884337 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.884397 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884356 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.884570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884551 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.884615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884570 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.884858 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884826 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.884858 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.884849 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.885083 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885066 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.885122 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885092 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.885328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885312 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.885364 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885331 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.885527 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885510 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.885586 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885528 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.885752 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885733 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.885801 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885753 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.885964 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885947 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.886007 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.885965 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.886169 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886152 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.886231 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886171 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.886387 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886369 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.886430 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886389 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.886612 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886593 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.886744 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886613 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.886840 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886823 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.886882 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.886841 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.887029 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887012 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.887088 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887029 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.887188 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887171 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.887250 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887190 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.887421 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887406 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.887484 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887425 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.887619 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887603 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.887683 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887619 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.887810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887794 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.887851 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887812 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.888000 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887986 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.888065 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.887999 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.888219 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888201 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.888263 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888220 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.888445 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888429 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.888482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888445 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.888647 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888630 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.888708 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888647 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.888840 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888820 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.888881 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.888842 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.889021 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889004 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.889063 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889030 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.889242 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889226 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.889288 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889242 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.889429 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889414 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.889476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889430 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.889623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889608 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.889682 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889624 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.889824 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889809 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.889824 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.889823 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.890183 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890161 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.890183 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890182 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.890551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890506 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.890551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890533 2564 scope.go:117] "RemoveContainer" containerID="93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf" Jul 02 23:04:09.890853 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890824 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf"} err="failed to get container status \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": rpc error: code = NotFound desc = could not find container \"93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf\": container with ID starting with 93dc1d80d0decaaf77a8b18b2523ae0a323342fd1add75ab89333e3f849cf4cf not found: ID does not exist" Jul 02 23:04:09.890853 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.890851 2564 scope.go:117] "RemoveContainer" containerID="12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359" Jul 02 23:04:09.891108 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891090 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359"} err="failed to get container status \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": rpc error: code = NotFound desc = could not find container \"12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359\": container with ID starting with 12b587e111c5d1be676b9da257b096591b9e13b58cfac72c39f29d615e890359 not found: ID does not exist" Jul 02 23:04:09.891162 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891109 2564 scope.go:117] "RemoveContainer" containerID="ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de" Jul 02 23:04:09.891367 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891348 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de"} err="failed to get container status \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": rpc error: code = NotFound desc = could not find container \"ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de\": container with ID starting with ba123b8dbf0fbb2ed5843d699f746ae5cce40dbca01642596bacb9537e91d8de not found: ID does not exist" Jul 02 23:04:09.891446 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891368 2564 scope.go:117] "RemoveContainer" containerID="81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d" Jul 02 23:04:09.891617 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891599 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d"} err="failed to get container status \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": rpc error: code = NotFound desc = could not find container \"81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d\": container with ID starting with 81661c19a16338b53e13f10c4217230ab7e140ed5a0587f85ba99f9fc504094d not found: ID does not exist" Jul 02 23:04:09.891709 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891618 2564 scope.go:117] "RemoveContainer" containerID="fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6" Jul 02 23:04:09.891887 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891868 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6"} err="failed to get container status \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": rpc error: code = NotFound desc = could not find container \"fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6\": container with ID starting with fe13e35158dc50e3a3c5e7b8036a5eeede3c917b6058f5446f3ca07e2d4f15a6 not found: ID does not exist" Jul 02 23:04:09.891929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.891888 2564 scope.go:117] "RemoveContainer" containerID="0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126" Jul 02 23:04:09.892099 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892081 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:09.892155 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892137 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126"} err="failed to get container status \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": rpc error: code = NotFound desc = could not find container \"0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126\": container with ID starting with 0a6e537707a53edd08533247f39bb82d0462124a45cb19c221ec9c89f5ab5126 not found: ID does not exist" Jul 02 23:04:09.892196 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892157 2564 scope.go:117] "RemoveContainer" containerID="38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593" Jul 02 23:04:09.892391 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892363 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593"} err="failed to get container status \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": rpc error: code = NotFound desc = could not find container \"38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593\": container with ID starting with 38331e9ab893d0cdd80809c3af421c2838ceb1549fe09a14800443948bc64593 not found: ID does not exist" Jul 02 23:04:09.892441 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892420 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-web" Jul 02 23:04:09.892441 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892434 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-web" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892449 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" containerName="registry" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892455 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" containerName="registry" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892463 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="init-config-reloader" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892468 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="init-config-reloader" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892474 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="thanos-sidecar" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892479 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="thanos-sidecar" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892488 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="prometheus" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892493 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="prometheus" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892499 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="config-reloader" Jul 02 23:04:09.892503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892505 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="config-reloader" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892510 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-thanos" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892515 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-thanos" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892524 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892529 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892578 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eeef74f-bb39-4814-aff8-bc85d5f7e97d" containerName="registry" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892586 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892591 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="config-reloader" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892599 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="prometheus" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892603 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-thanos" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892609 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="thanos-sidecar" Jul 02 23:04:09.892798 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.892614 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" containerName="kube-rbac-proxy-web" Jul 02 23:04:09.896938 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.896922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.899782 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.899761 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 23:04:09.899863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.899763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 23:04:09.899863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.899796 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 23:04:09.900103 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 23:04:09.900172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900141 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 23:04:09.900230 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 23:04:09.900230 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900213 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwgrz\"" Jul 02 23:04:09.900379 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900358 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 23:04:09.900580 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900564 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 23:04:09.900711 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 23:04:09.900794 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900731 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e90a5n52pkm6r\"" Jul 02 23:04:09.900861 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900808 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 23:04:09.900917 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 23:04:09.900970 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.900944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 23:04:09.901217 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.901175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 23:04:09.909173 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.909145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 23:04:09.910623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.910603 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 23:04:09.912039 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.911999 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:09.992643 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kdx\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-kube-api-access-86kdx\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.992935 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.992959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:09.993392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:09.993360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.093913 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.093858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.093913 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.093886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.093913 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.093903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.093917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kdx\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-kube-api-access-86kdx\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.094450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.094574 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.095001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.095563 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.095542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.096764 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.096640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.097067 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.096901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.097067 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097000 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.097067 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.097067 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097007 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.097294 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.098186 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3718cf27-9afa-492f-a52d-53759ab749b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.098186 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.097769 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.098186 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.098065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.098611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.098588 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.098925 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.098904 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.099170 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.099150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-config\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.099427 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.099407 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3718cf27-9afa-492f-a52d-53759ab749b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.099511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.099494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.099542 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.099513 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.099598 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.099582 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3718cf27-9afa-492f-a52d-53759ab749b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.102899 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.102879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kdx\" (UniqueName: \"kubernetes.io/projected/3718cf27-9afa-492f-a52d-53759ab749b2-kube-api-access-86kdx\") pod \"prometheus-k8s-0\" (UID: \"3718cf27-9afa-492f-a52d-53759ab749b2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.209369 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.209343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:04:10.347466 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.347406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:04:10.349692 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:04:10.349651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3718cf27_9afa_492f_a52d_53759ab749b2.slice/crio-0dd92ad562bf675dbeac4bb8745f05da0c33e0a54d63d2141efc7527bd2b6bef WatchSource:0}: Error finding container 0dd92ad562bf675dbeac4bb8745f05da0c33e0a54d63d2141efc7527bd2b6bef: Status 404 returned error can't find the container with id 0dd92ad562bf675dbeac4bb8745f05da0c33e0a54d63d2141efc7527bd2b6bef Jul 02 23:04:10.839124 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.839089 2564 generic.go:356] "Generic (PLEG): container finished" podID="3718cf27-9afa-492f-a52d-53759ab749b2" containerID="074499f4a1be5133070aae9df2045cd8e88ad895d5c42b7a5b62fc677c703b05" exitCode=0 Jul 02 23:04:10.839283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.839144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerDied","Data":"074499f4a1be5133070aae9df2045cd8e88ad895d5c42b7a5b62fc677c703b05"} Jul 02 23:04:10.839283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.839209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"0dd92ad562bf675dbeac4bb8745f05da0c33e0a54d63d2141efc7527bd2b6bef"} Jul 02 23:04:10.926010 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:10.925985 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1229a916-3989-4d6c-bd13-b6cf40afe210" path="/var/lib/kubelet/pods/1229a916-3989-4d6c-bd13-b6cf40afe210/volumes" Jul 02 23:04:11.851587 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"c78a4e2f723f95e0c28212c93c72f566ebd6cfa1d6fe16cf13260d62bad7da24"} Jul 02 23:04:11.851996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"d7d93dcf88596e19d4705780b4d9f54bed6adc4fabd36ae31b200166d7962879"} Jul 02 23:04:11.851996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"76a8fbe37cffa583b73bc3bda99efae592f1db69dcd91955d9732c1ff0bf28ef"} Jul 02 23:04:11.851996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"5aee17c327fd9e5bb42de76ba922f4073132b8cd4818d71b6a21d49cd9f2be3c"} Jul 02 23:04:11.851996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"3504c9d3ff66f2b41df5cda93ef31828be1d485d1c34ec9e892c88f30685c38a"} Jul 02 23:04:11.851996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.851829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3718cf27-9afa-492f-a52d-53759ab749b2","Type":"ContainerStarted","Data":"2d55ec8e05799ed8f9e2d3c2ff71464d777877383d6a71c47c19d088826879ae"} Jul 02 23:04:11.883238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:11.883181 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.864767322 podStartE2EDuration="2.883160864s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.393542ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:04:11.880739865 +0000 UTC m=+173.628038974" watchObservedRunningTime="2026-07-02 23:04:11.883160864 +0000 UTC m=+173.630459973" Jul 02 23:04:15.209833 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:04:15.209788 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:05:10.210423 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:05:10.210388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:05:10.225386 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:05:10.225364 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:05:11.105451 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:05:11.105426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:06:18.680757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:06:18.680724 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:06:18.685287 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:06:18.685265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:06:18.687104 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:06:18.687084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:06:18.692005 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:06:18.691980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:06:18.692907 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:06:18.692877 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 23:07:20.686309 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.686231 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg"] Jul 02 23:07:20.689420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.689403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.692264 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.692229 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 23:07:20.692393 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.692294 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 23:07:20.692938 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.692911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tznn6\"" Jul 02 23:07:20.693061 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.692961 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 23:07:20.693061 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.692983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 23:07:20.703555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.703510 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg"] Jul 02 23:07:20.775897 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.775854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.775897 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.775895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.776165 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.775918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.776165 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.775938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rp5\" (UniqueName: \"kubernetes.io/projected/1078571f-5497-4cb6-839f-8261aa73bb54-kube-api-access-f9rp5\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.776165 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.776013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877293 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877293 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rp5\" (UniqueName: \"kubernetes.io/projected/1078571f-5497-4cb6-839f-8261aa73bb54-kube-api-access-f9rp5\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.877863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.877829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.879702 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.879680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1078571f-5497-4cb6-839f-8261aa73bb54-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.879850 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.879826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.880058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.880036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1078571f-5497-4cb6-839f-8261aa73bb54-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:20.886101 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:20.886074 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rp5\" (UniqueName: \"kubernetes.io/projected/1078571f-5497-4cb6-839f-8261aa73bb54-kube-api-access-f9rp5\") pod \"opendatahub-operator-controller-manager-676b9dcdc-jw8rg\" (UID: \"1078571f-5497-4cb6-839f-8261aa73bb54\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:21.000754 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:21.000643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:21.143988 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:21.143952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg"] Jul 02 23:07:21.147795 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:07:21.147769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1078571f_5497_4cb6_839f_8261aa73bb54.slice/crio-f9e5d50c7f272abb26a5e490086e5475abfe0409d592aee3a4a70ad8c6c300a3 WatchSource:0}: Error finding container f9e5d50c7f272abb26a5e490086e5475abfe0409d592aee3a4a70ad8c6c300a3: Status 404 returned error can't find the container with id f9e5d50c7f272abb26a5e490086e5475abfe0409d592aee3a4a70ad8c6c300a3 Jul 02 23:07:21.149481 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:21.149461 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:07:21.591703 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:21.591654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" event={"ID":"1078571f-5497-4cb6-839f-8261aa73bb54","Type":"ContainerStarted","Data":"f9e5d50c7f272abb26a5e490086e5475abfe0409d592aee3a4a70ad8c6c300a3"} Jul 02 23:07:24.609276 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:24.609238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" event={"ID":"1078571f-5497-4cb6-839f-8261aa73bb54","Type":"ContainerStarted","Data":"afb7347c1b38360b616588c64d2efce4ad0c9ed28fff5c07bb243e6a709e8b05"} Jul 02 23:07:25.615010 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:25.614973 2564 generic.go:356] "Generic (PLEG): container finished" podID="1078571f-5497-4cb6-839f-8261aa73bb54" containerID="afb7347c1b38360b616588c64d2efce4ad0c9ed28fff5c07bb243e6a709e8b05" exitCode=0 Jul 02 23:07:25.615417 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:25.615058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" event={"ID":"1078571f-5497-4cb6-839f-8261aa73bb54","Type":"ContainerDied","Data":"afb7347c1b38360b616588c64d2efce4ad0c9ed28fff5c07bb243e6a709e8b05"} Jul 02 23:07:26.622328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:26.622285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" event={"ID":"1078571f-5497-4cb6-839f-8261aa73bb54","Type":"ContainerStarted","Data":"8df359750725dfcb63fe100ea56b2a6f58b9126c44644db369be19dcb1d0855b"} Jul 02 23:07:26.622780 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:26.622426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:26.645495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:26.645439 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" podStartSLOduration=2.341373571 podStartE2EDuration="6.645422987s" totalImagesPullingTime="3.202771175s" totalInitContainerRuntime="1.101278241s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:26.642778636 +0000 UTC m=+368.390077748" watchObservedRunningTime="2026-07-02 23:07:26.645422987 +0000 UTC m=+368.392722096" Jul 02 23:07:37.628241 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:37.628207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-jw8rg" Jul 02 23:07:40.794321 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.794248 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd"] Jul 02 23:07:40.804607 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.804580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:40.808611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808583 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 23:07:40.808611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 23:07:40.808820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808634 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 23:07:40.808820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kx4jp\"" Jul 02 23:07:40.808820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:07:40.808820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.808590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 23:07:40.816250 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.816225 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd"] Jul 02 23:07:40.951354 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.951322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca363977-0346-4b31-8919-8876e73e3b81-manager-config\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:40.951504 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.951373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:40.951504 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.951397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-metrics-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:40.951504 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:40.951430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcghz\" (UniqueName: \"kubernetes.io/projected/ca363977-0346-4b31-8919-8876e73e3b81-kube-api-access-dcghz\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.052130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.052040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcghz\" (UniqueName: \"kubernetes.io/projected/ca363977-0346-4b31-8919-8876e73e3b81-kube-api-access-dcghz\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.052306 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.052236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca363977-0346-4b31-8919-8876e73e3b81-manager-config\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.052384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.052331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.052384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.052361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-metrics-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.052999 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.052974 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ca363977-0346-4b31-8919-8876e73e3b81-manager-config\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.054825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.054794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.054952 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.054930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca363977-0346-4b31-8919-8876e73e3b81-metrics-cert\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.060566 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.060546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcghz\" (UniqueName: \"kubernetes.io/projected/ca363977-0346-4b31-8919-8876e73e3b81-kube-api-access-dcghz\") pod \"lws-controller-manager-7f69f5c6b6-7b4fd\" (UID: \"ca363977-0346-4b31-8919-8876e73e3b81\") " pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.116031 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.115997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:41.261891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.261856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd"] Jul 02 23:07:41.265426 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:07:41.265394 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca363977_0346_4b31_8919_8876e73e3b81.slice/crio-80fbc3e587cc2912bfd4835f9dbee472f82860fd43be7da2e9873c096b204c2b WatchSource:0}: Error finding container 80fbc3e587cc2912bfd4835f9dbee472f82860fd43be7da2e9873c096b204c2b: Status 404 returned error can't find the container with id 80fbc3e587cc2912bfd4835f9dbee472f82860fd43be7da2e9873c096b204c2b Jul 02 23:07:41.687635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:41.687598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" event={"ID":"ca363977-0346-4b31-8919-8876e73e3b81","Type":"ContainerStarted","Data":"80fbc3e587cc2912bfd4835f9dbee472f82860fd43be7da2e9873c096b204c2b"} Jul 02 23:07:44.705518 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:44.705481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" event={"ID":"ca363977-0346-4b31-8919-8876e73e3b81","Type":"ContainerStarted","Data":"1b85a36e8252092dc3cac24d61f119507f4025dcbe610ad6ae99a40e77ca1f07"} Jul 02 23:07:44.706045 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:44.705546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:07:44.722495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:44.722446 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" podStartSLOduration=1.8885060390000001 podStartE2EDuration="4.722430538s" totalImagesPullingTime="2.833924499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:44.721983043 +0000 UTC m=+386.469282154" watchObservedRunningTime="2026-07-02 23:07:44.722430538 +0000 UTC m=+386.469729648" Jul 02 23:07:47.219157 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.219122 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb"] Jul 02 23:07:47.222503 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.222484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.226737 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.226707 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 23:07:47.227029 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.227011 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vml6k\"" Jul 02 23:07:47.244902 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.244876 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb"] Jul 02 23:07:47.308745 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.308911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.308911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.308911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.308911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9238523-af7a-4885-be89-37b00f3f842f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.309117 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghr7l\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-kube-api-access-ghr7l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.309117 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.309117 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.308985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.309117 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.309013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9238523-af7a-4885-be89-37b00f3f842f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410088 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410088 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9238523-af7a-4885-be89-37b00f3f842f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghr7l\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-kube-api-access-ghr7l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410644 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410644 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.410644 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.410584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9238523-af7a-4885-be89-37b00f3f842f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.411173 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.411148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9238523-af7a-4885-be89-37b00f3f842f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.411302 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.411189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.411302 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.411209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.411477 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.411447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.413192 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.413161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9238523-af7a-4885-be89-37b00f3f842f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.413495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.413475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9238523-af7a-4885-be89-37b00f3f842f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.421505 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.421475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.421603 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.421512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghr7l\" (UniqueName: \"kubernetes.io/projected/d9238523-af7a-4885-be89-37b00f3f842f-kube-api-access-ghr7l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bkjxb\" (UID: \"d9238523-af7a-4885-be89-37b00f3f842f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.533340 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.533307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:47.683579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.683542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb"] Jul 02 23:07:47.686427 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:07:47.686395 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9238523_af7a_4885_be89_37b00f3f842f.slice/crio-5b555ce08cc4b0f928de72b711e30ae0e7099fc318118bcf127608b58538e3cf WatchSource:0}: Error finding container 5b555ce08cc4b0f928de72b711e30ae0e7099fc318118bcf127608b58538e3cf: Status 404 returned error can't find the container with id 5b555ce08cc4b0f928de72b711e30ae0e7099fc318118bcf127608b58538e3cf Jul 02 23:07:47.718782 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:47.718754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" event={"ID":"d9238523-af7a-4885-be89-37b00f3f842f","Type":"ContainerStarted","Data":"5b555ce08cc4b0f928de72b711e30ae0e7099fc318118bcf127608b58538e3cf"} Jul 02 23:07:49.128785 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.128751 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7"] Jul 02 23:07:49.132331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.132302 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.135699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.135223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 23:07:49.135699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.135236 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 23:07:49.135699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.135223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 23:07:49.135699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.135316 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dhmg8\"" Jul 02 23:07:49.144513 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.144486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7"] Jul 02 23:07:49.229437 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4gl\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-kube-api-access-mc4gl\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.229869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.229734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331082 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331273 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331092 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331273 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331273 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4gl\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-kube-api-access-mc4gl\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.331442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.331341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.332064 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.332038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.333855 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.333833 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.334060 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.334042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.334273 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.334247 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.334398 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.334374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.351804 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.351766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4gl\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-kube-api-access-mc4gl\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.353335 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.353305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf7f9e-6649-4f95-80ba-464fd6d1abf1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d88v7\" (UID: \"6edf7f9e-6649-4f95-80ba-464fd6d1abf1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:49.444561 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:49.444473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:50.370825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.370775 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:07:50.371217 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.370872 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:07:50.371217 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.370921 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:07:50.457226 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.457194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7"] Jul 02 23:07:50.458179 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:07:50.458149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edf7f9e_6649_4f95_80ba_464fd6d1abf1.slice/crio-d0a478850b9273378d86c3c0aa1d9e9d09d7b72416dc5d9e0dafbba950a518f5 WatchSource:0}: Error finding container d0a478850b9273378d86c3c0aa1d9e9d09d7b72416dc5d9e0dafbba950a518f5: Status 404 returned error can't find the container with id d0a478850b9273378d86c3c0aa1d9e9d09d7b72416dc5d9e0dafbba950a518f5 Jul 02 23:07:50.740844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.740733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" event={"ID":"d9238523-af7a-4885-be89-37b00f3f842f","Type":"ContainerStarted","Data":"7d17e3a81aaacdb9a890a4d79d9a55156c78cb58eac6cc646427f0b552e65a7f"} Jul 02 23:07:50.741993 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.741969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" event={"ID":"6edf7f9e-6649-4f95-80ba-464fd6d1abf1","Type":"ContainerStarted","Data":"d0a478850b9273378d86c3c0aa1d9e9d09d7b72416dc5d9e0dafbba950a518f5"} Jul 02 23:07:50.765942 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:50.765884 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" podStartSLOduration=1.084269208 podStartE2EDuration="3.765866942s" totalImagesPullingTime="2.681597734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:50.764412215 +0000 UTC m=+392.511711327" watchObservedRunningTime="2026-07-02 23:07:50.765866942 +0000 UTC m=+392.513166051" Jul 02 23:07:51.533927 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:51.533891 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:51.539256 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:51.539215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:51.746760 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:51.746717 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:51.747801 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:51.747777 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bkjxb" Jul 02 23:07:52.866836 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:52.866800 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:07:52.867123 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:52.866866 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:07:53.757954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:53.757914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" event={"ID":"6edf7f9e-6649-4f95-80ba-464fd6d1abf1","Type":"ContainerStarted","Data":"8bc3344b9ac3d2fb210850f322550ce606d32a734d70a042ab051bf11f3f62e0"} Jul 02 23:07:53.758171 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:53.758148 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:53.760044 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:53.760014 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-d88v7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 23:07:53.760151 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:53.760074 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" podUID="6edf7f9e-6649-4f95-80ba-464fd6d1abf1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:07:53.781701 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:53.781609 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" podStartSLOduration=2.375191302 podStartE2EDuration="4.781590855s" totalImagesPullingTime="2.406399553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:53.779171104 +0000 UTC m=+395.526470215" watchObservedRunningTime="2026-07-02 23:07:53.781590855 +0000 UTC m=+395.528889967" Jul 02 23:07:54.762870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:54.762838 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d88v7" Jul 02 23:07:55.711987 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:07:55.711958 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f69f5c6b6-7b4fd" Jul 02 23:10:24.107265 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.107192 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf"] Jul 02 23:10:24.110308 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.110290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.112846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.112826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zv82d\"" Jul 02 23:10:24.123056 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.123036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf"] Jul 02 23:10:24.231284 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgzk\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-kube-api-access-rzgzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231284 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cafcae-f664-482e-801a-545e0435398e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231811 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.231811 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.231640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cafcae-f664-482e-801a-545e0435398e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332105 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332105 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cafcae-f664-482e-801a-545e0435398e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgzk\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-kube-api-access-rzgzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cafcae-f664-482e-801a-545e0435398e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332330 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332702 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332702 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332651 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332814 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.332863 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.332811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.333022 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.333003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cafcae-f664-482e-801a-545e0435398e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.334529 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.334508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cafcae-f664-482e-801a-545e0435398e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.334839 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.334823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cafcae-f664-482e-801a-545e0435398e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.340510 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.340483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.341237 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.341214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgzk\" (UniqueName: \"kubernetes.io/projected/a5cafcae-f664-482e-801a-545e0435398e-kube-api-access-rzgzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-kdvkf\" (UID: \"a5cafcae-f664-482e-801a-545e0435398e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.420376 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.420295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:24.548149 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.548115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf"] Jul 02 23:10:24.551601 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:10:24.551573 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cafcae_f664_482e_801a_545e0435398e.slice/crio-e022158c337d9bdbe31477fddf4add04215d4fb16b11433df5be44642f7f21be WatchSource:0}: Error finding container e022158c337d9bdbe31477fddf4add04215d4fb16b11433df5be44642f7f21be: Status 404 returned error can't find the container with id e022158c337d9bdbe31477fddf4add04215d4fb16b11433df5be44642f7f21be Jul 02 23:10:24.553611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.553570 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:10:24.553704 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.553683 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:10:24.553750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:24.553733 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:10:25.412997 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:25.412959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" event={"ID":"a5cafcae-f664-482e-801a-545e0435398e","Type":"ContainerStarted","Data":"02ae7421b31c887c997f1ff732b301de1d5c80ffcdc3cdbdf1202e2907bc16d5"} Jul 02 23:10:25.413351 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:25.413015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" event={"ID":"a5cafcae-f664-482e-801a-545e0435398e","Type":"ContainerStarted","Data":"e022158c337d9bdbe31477fddf4add04215d4fb16b11433df5be44642f7f21be"} Jul 02 23:10:25.421136 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:25.421114 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:25.426134 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:25.426112 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:25.438050 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:25.438005 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" podStartSLOduration=1.43798862 podStartE2EDuration="1.43798862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:25.435987745 +0000 UTC m=+547.183286870" watchObservedRunningTime="2026-07-02 23:10:25.43798862 +0000 UTC m=+547.185287729" Jul 02 23:10:26.417578 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:26.417550 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:10:26.418319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:10:26.418302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:11:18.708772 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:18.708747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:11:18.712963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:18.712942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:11:18.714147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:18.714126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:11:18.718424 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:18.718407 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:11:23.605252 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.605224 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:11:23.608742 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.608724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.611232 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.611208 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 23:11:23.612399 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.612380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zfkp8\"" Jul 02 23:11:23.612539 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.612424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 23:11:23.618569 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.618548 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:11:23.671954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.671934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxkj8\" (UniqueName: \"kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.672054 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.671961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.772453 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.772433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxkj8\" (UniqueName: \"kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.772541 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.772459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.774831 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.774810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.781350 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.781332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxkj8\" (UniqueName: \"kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8\") pod \"maas-controller-679fc747b4-cg2g4\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:23.919292 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:23.919237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:24.066769 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:24.066742 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:11:24.068163 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:11:24.068131 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ab6fd0_eb33_41f8_80d9_5c411aab7c87.slice/crio-d58370941d046096fe8f32e3f51f82bfc3e3d5f52f1954fdaee53c100709512f WatchSource:0}: Error finding container d58370941d046096fe8f32e3f51f82bfc3e3d5f52f1954fdaee53c100709512f: Status 404 returned error can't find the container with id d58370941d046096fe8f32e3f51f82bfc3e3d5f52f1954fdaee53c100709512f Jul 02 23:11:24.700986 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:24.700936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-cg2g4" event={"ID":"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87","Type":"ContainerStarted","Data":"d58370941d046096fe8f32e3f51f82bfc3e3d5f52f1954fdaee53c100709512f"} Jul 02 23:11:26.712381 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:26.712348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-cg2g4" event={"ID":"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87","Type":"ContainerStarted","Data":"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91"} Jul 02 23:11:26.712783 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:26.712466 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:26.735136 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:26.735089 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-679fc747b4-cg2g4" podStartSLOduration=1.529221535 podStartE2EDuration="3.735078444s" totalImagesPullingTime="2.205856909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.733536525 +0000 UTC m=+608.480835634" watchObservedRunningTime="2026-07-02 23:11:26.735078444 +0000 UTC m=+608.482377552" Jul 02 23:11:37.723930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:37.723897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:11:58.131437 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.131401 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g78dn"] Jul 02 23:11:58.134817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.134793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.138225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.138205 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sqstf\"" Jul 02 23:11:58.138336 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.138276 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 23:11:58.146721 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.146700 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g78dn"] Jul 02 23:11:58.265489 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.265458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvp28\" (UniqueName: \"kubernetes.io/projected/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-kube-api-access-lvp28\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.265610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.265503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.366451 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.366418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvp28\" (UniqueName: \"kubernetes.io/projected/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-kube-api-access-lvp28\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.366594 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.366468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.367134 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.367115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.375091 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.375062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvp28\" (UniqueName: \"kubernetes.io/projected/0c22c25a-0235-4e86-8a3c-d2f72c7c8112-kube-api-access-lvp28\") pod \"payload-pre-processing-7964457696-g78dn\" (UID: \"0c22c25a-0235-4e86-8a3c-d2f72c7c8112\") " pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.444954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.444898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:11:58.570394 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.570361 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g78dn"] Jul 02 23:11:58.572640 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:11:58.572613 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c22c25a_0235_4e86_8a3c_d2f72c7c8112.slice/crio-8bb52e988b02e9cc56fc90f16d7c81f84e412975fc1e3b2d6b77c6d58c98a3e0 WatchSource:0}: Error finding container 8bb52e988b02e9cc56fc90f16d7c81f84e412975fc1e3b2d6b77c6d58c98a3e0: Status 404 returned error can't find the container with id 8bb52e988b02e9cc56fc90f16d7c81f84e412975fc1e3b2d6b77c6d58c98a3e0 Jul 02 23:11:58.863594 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:11:58.863561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" event={"ID":"0c22c25a-0235-4e86-8a3c-d2f72c7c8112","Type":"ContainerStarted","Data":"8bb52e988b02e9cc56fc90f16d7c81f84e412975fc1e3b2d6b77c6d58c98a3e0"} Jul 02 23:12:00.875787 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:00.875738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" event={"ID":"0c22c25a-0235-4e86-8a3c-d2f72c7c8112","Type":"ContainerStarted","Data":"35c155917f1a8784eab6cd53ff1b88e57a31564f5219db31cd0a6594bb83bc0f"} Jul 02 23:12:00.876651 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:00.876624 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:12:00.894624 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:00.894538 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" podStartSLOduration=1.4340686599999999 podStartE2EDuration="2.894519136s" totalImagesPullingTime="1.460450476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:00.892289516 +0000 UTC m=+642.639588625" watchObservedRunningTime="2026-07-02 23:12:00.894519136 +0000 UTC m=+642.641818245" Jul 02 23:12:05.901502 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.901471 2564 generic.go:356] "Generic (PLEG): container finished" podID="a5cafcae-f664-482e-801a-545e0435398e" containerID="02ae7421b31c887c997f1ff732b301de1d5c80ffcdc3cdbdf1202e2907bc16d5" exitCode=0 Jul 02 23:12:05.901870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.901545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" event={"ID":"a5cafcae-f664-482e-801a-545e0435398e","Type":"ContainerDied","Data":"02ae7421b31c887c997f1ff732b301de1d5c80ffcdc3cdbdf1202e2907bc16d5"} Jul 02 23:12:05.901914 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.901880 2564 scope.go:117] "RemoveContainer" containerID="02ae7421b31c887c997f1ff732b301de1d5c80ffcdc3cdbdf1202e2907bc16d5" Jul 02 23:12:05.902774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.902747 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:12:05.902842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.902814 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:12:05.903045 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:05.902847 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:12:06.907859 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:06.907826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" event={"ID":"a5cafcae-f664-482e-801a-545e0435398e","Type":"ContainerStarted","Data":"e083cae78720fa95d9bcfdfb0b3377915e2a2888ee1fddd5cd230890f5105445"} Jul 02 23:12:07.421077 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:07.421047 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:12:07.422091 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:07.422059 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kdvkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 02 23:12:07.422459 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:07.422118 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" podUID="a5cafcae-f664-482e-801a-545e0435398e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 02 23:12:08.421058 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:08.421023 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kdvkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 02 23:12:08.421447 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:08.421091 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" podUID="a5cafcae-f664-482e-801a-545e0435398e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 02 23:12:09.421471 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:09.421430 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kdvkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 02 23:12:09.421939 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:09.421486 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" podUID="a5cafcae-f664-482e-801a-545e0435398e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 02 23:12:10.421616 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:10.421582 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kdvkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 02 23:12:10.422002 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:10.421634 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" podUID="a5cafcae-f664-482e-801a-545e0435398e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 02 23:12:11.418495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:11.418457 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:12:11.424702 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:11.424655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:12:11.929118 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:11.929090 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kdvkf" Jul 02 23:12:12.889196 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:12.889166 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-g78dn" Jul 02 23:12:22.994107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:22.994072 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc"] Jul 02 23:12:22.997795 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:22.997771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.000514 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.000488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 23:12:23.000623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.000509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pgtwg\"" Jul 02 23:12:23.001440 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.001422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 23:12:23.001514 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.001453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 23:12:23.008455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.008435 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc"] Jul 02 23:12:23.106971 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.106939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.107092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.107000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94n2\" (UniqueName: \"kubernetes.io/projected/caff459f-f75b-4d21-93cc-d8b9d732e47b-kube-api-access-s94n2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.107092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.107022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.107092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.107053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.107092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.107081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caff459f-f75b-4d21-93cc-d8b9d732e47b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.107226 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.107100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.207946 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.207918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208139 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.207979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94n2\" (UniqueName: \"kubernetes.io/projected/caff459f-f75b-4d21-93cc-d8b9d732e47b-kube-api-access-s94n2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208139 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208139 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208139 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caff459f-f75b-4d21-93cc-d8b9d732e47b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208139 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208406 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208387 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208462 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.208500 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.208473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.210315 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.210290 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caff459f-f75b-4d21-93cc-d8b9d732e47b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.210599 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.210581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caff459f-f75b-4d21-93cc-d8b9d732e47b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.216008 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.215986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94n2\" (UniqueName: \"kubernetes.io/projected/caff459f-f75b-4d21-93cc-d8b9d732e47b-kube-api-access-s94n2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2n6vc\" (UID: \"caff459f-f75b-4d21-93cc-d8b9d732e47b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.308526 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.308495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:23.439235 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.439208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc"] Jul 02 23:12:23.441058 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:12:23.441031 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaff459f_f75b_4d21_93cc_d8b9d732e47b.slice/crio-9965603956ec4723ffe38be16778974d2e665f632e06ffa4e12382cd5aa229f6 WatchSource:0}: Error finding container 9965603956ec4723ffe38be16778974d2e665f632e06ffa4e12382cd5aa229f6: Status 404 returned error can't find the container with id 9965603956ec4723ffe38be16778974d2e665f632e06ffa4e12382cd5aa229f6 Jul 02 23:12:23.442891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.442869 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:12:23.993865 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:23.993817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" event={"ID":"caff459f-f75b-4d21-93cc-d8b9d732e47b","Type":"ContainerStarted","Data":"9965603956ec4723ffe38be16778974d2e665f632e06ffa4e12382cd5aa229f6"} Jul 02 23:12:25.000558 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:25.000519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" event={"ID":"caff459f-f75b-4d21-93cc-d8b9d732e47b","Type":"ContainerStarted","Data":"455cc9ccfc0f982bcce2e6c454b3a4ba82eb16fb89f36262c522acd88a96d62f"} Jul 02 23:12:25.019552 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:25.019506 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" podStartSLOduration=1.971661937 podStartE2EDuration="3.019492639s" totalImagesPullingTime="1.047830702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:25.017009172 +0000 UTC m=+666.764308281" watchObservedRunningTime="2026-07-02 23:12:25.019492639 +0000 UTC m=+666.766791748" Jul 02 23:12:33.309256 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:33.309209 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:33.309731 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:33.309281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:33.321603 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:33.321576 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:34.053122 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:34.053090 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2n6vc" Jul 02 23:12:34.898257 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:34.898221 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v"] Jul 02 23:12:34.904198 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:34.904177 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:34.906782 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:34.906766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 23:12:34.913067 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:34.913043 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v"] Jul 02 23:12:35.013686 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.013686 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.013882 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbc8\" (UniqueName: \"kubernetes.io/projected/daae85c0-4fa7-461e-862f-8355c7dc0496-kube-api-access-cpbc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.013882 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daae85c0-4fa7-461e-862f-8355c7dc0496-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.013949 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.013979 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.013956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115299 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbc8\" (UniqueName: \"kubernetes.io/projected/daae85c0-4fa7-461e-862f-8355c7dc0496-kube-api-access-cpbc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daae85c0-4fa7-461e-862f-8355c7dc0496-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115719 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115719 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.115825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.115775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.117897 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.117868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daae85c0-4fa7-461e-862f-8355c7dc0496-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.118003 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.117987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daae85c0-4fa7-461e-862f-8355c7dc0496-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.123646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.123627 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbc8\" (UniqueName: \"kubernetes.io/projected/daae85c0-4fa7-461e-862f-8355c7dc0496-kube-api-access-cpbc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zkk8v\" (UID: \"daae85c0-4fa7-461e-862f-8355c7dc0496\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.214883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.214807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:35.344315 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:35.344287 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v"] Jul 02 23:12:35.346322 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:12:35.346289 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaae85c0_4fa7_461e_862f_8355c7dc0496.slice/crio-89f79c964089d3ebf524b6abc5b331778480100aae09f61d12f693946e4fa175 WatchSource:0}: Error finding container 89f79c964089d3ebf524b6abc5b331778480100aae09f61d12f693946e4fa175: Status 404 returned error can't find the container with id 89f79c964089d3ebf524b6abc5b331778480100aae09f61d12f693946e4fa175 Jul 02 23:12:36.052624 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:36.052594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" event={"ID":"daae85c0-4fa7-461e-862f-8355c7dc0496","Type":"ContainerStarted","Data":"f3d1ebf5f229b0bcdebadf92e60d527420df0e0b1939cd86e011b3a466cbe3fd"} Jul 02 23:12:36.053004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:36.052645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" event={"ID":"daae85c0-4fa7-461e-862f-8355c7dc0496","Type":"ContainerStarted","Data":"89f79c964089d3ebf524b6abc5b331778480100aae09f61d12f693946e4fa175"} Jul 02 23:12:36.071221 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:36.071178 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" podStartSLOduration=1.8752067079999999 podStartE2EDuration="2.071138603s" totalImagesPullingTime="195.931895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:36.07021247 +0000 UTC m=+677.817511582" watchObservedRunningTime="2026-07-02 23:12:36.071138603 +0000 UTC m=+677.818437713" Jul 02 23:12:41.187826 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.187794 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2"] Jul 02 23:12:41.191388 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.191365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.195362 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.195342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 23:12:41.201973 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.201947 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2"] Jul 02 23:12:41.376695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.376870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clpb6\" (UniqueName: \"kubernetes.io/projected/192f2b80-8a5f-46a9-9e34-463210cb5ed7-kube-api-access-clpb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.376870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.376870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.376992 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.376992 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.376928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478083 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478083 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478334 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clpb6\" (UniqueName: \"kubernetes.io/projected/192f2b80-8a5f-46a9-9e34-463210cb5ed7-kube-api-access-clpb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478334 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478470 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478470 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.478651 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.478629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.480450 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.480418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/192f2b80-8a5f-46a9-9e34-463210cb5ed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.480698 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.480680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/192f2b80-8a5f-46a9-9e34-463210cb5ed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.487514 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.487485 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clpb6\" (UniqueName: \"kubernetes.io/projected/192f2b80-8a5f-46a9-9e34-463210cb5ed7-kube-api-access-clpb6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2\" (UID: \"192f2b80-8a5f-46a9-9e34-463210cb5ed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.502392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.502357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:41.642470 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:41.642439 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2"] Jul 02 23:12:41.644880 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:12:41.644853 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192f2b80_8a5f_46a9_9e34_463210cb5ed7.slice/crio-f587e7628132936e66c06237847f2bc05d63c484946cf6a3ac67669cb56d8301 WatchSource:0}: Error finding container f587e7628132936e66c06237847f2bc05d63c484946cf6a3ac67669cb56d8301: Status 404 returned error can't find the container with id f587e7628132936e66c06237847f2bc05d63c484946cf6a3ac67669cb56d8301 Jul 02 23:12:42.085559 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:42.085469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" event={"ID":"192f2b80-8a5f-46a9-9e34-463210cb5ed7","Type":"ContainerStarted","Data":"264d665983d99897b94eb97f376b2cd5a19c3050cd2525eebe8895a814e07ad0"} Jul 02 23:12:42.085559 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:42.085523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" event={"ID":"192f2b80-8a5f-46a9-9e34-463210cb5ed7","Type":"ContainerStarted","Data":"f587e7628132936e66c06237847f2bc05d63c484946cf6a3ac67669cb56d8301"} Jul 02 23:12:42.108961 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:42.108895 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" podStartSLOduration=0.920023615 podStartE2EDuration="1.108876143s" totalImagesPullingTime="188.852528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:42.106755125 +0000 UTC m=+683.854054233" watchObservedRunningTime="2026-07-02 23:12:42.108876143 +0000 UTC m=+683.856175253" Jul 02 23:12:45.215246 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:45.215217 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:45.215699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:45.215296 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:45.228203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:45.228174 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:46.116266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:46.116236 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zkk8v" Jul 02 23:12:51.502802 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:51.502766 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:51.503185 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:51.502851 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:51.515016 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:51.514993 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:12:52.154295 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:12:52.154264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2" Jul 02 23:15:00.140531 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.140501 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717235-645lb"] Jul 02 23:15:00.143951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.143935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:00.146512 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.146490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mvtr\"" Jul 02 23:15:00.150987 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.150957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717235-645lb"] Jul 02 23:15:00.309529 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.309504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwnnp\" (UniqueName: \"kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp\") pod \"maas-api-key-cleanup-29717235-645lb\" (UID: \"9c3941d6-6c42-48c7-8c0d-650b6ac8d933\") " pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:00.410125 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.410065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwnnp\" (UniqueName: \"kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp\") pod \"maas-api-key-cleanup-29717235-645lb\" (UID: \"9c3941d6-6c42-48c7-8c0d-650b6ac8d933\") " pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:00.419820 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.419798 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwnnp\" (UniqueName: \"kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp\") pod \"maas-api-key-cleanup-29717235-645lb\" (UID: \"9c3941d6-6c42-48c7-8c0d-650b6ac8d933\") " pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:00.454729 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.454704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:00.784383 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:00.784357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717235-645lb"] Jul 02 23:15:00.786112 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:15:00.786083 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3941d6_6c42_48c7_8c0d_650b6ac8d933.slice/crio-a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae WatchSource:0}: Error finding container a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae: Status 404 returned error can't find the container with id a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae Jul 02 23:15:01.746849 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:01.746810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" event={"ID":"9c3941d6-6c42-48c7-8c0d-650b6ac8d933","Type":"ContainerStarted","Data":"a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae"} Jul 02 23:15:07.778688 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:07.778640 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" event={"ID":"9c3941d6-6c42-48c7-8c0d-650b6ac8d933","Type":"ContainerStarted","Data":"0c65372578b6969b794ecf7f0436ef9fa5e55396ac4d88db7e96c6c99ef9ac96"} Jul 02 23:15:07.795368 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:07.795319 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" podStartSLOduration=1.193760914 podStartE2EDuration="7.79530734s" totalImagesPullingTime="6.601546426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:07.793460572 +0000 UTC m=+829.540759682" watchObservedRunningTime="2026-07-02 23:15:07.79530734 +0000 UTC m=+829.542606448" Jul 02 23:15:08.784523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:08.784488 2564 generic.go:356] "Generic (PLEG): container finished" podID="9c3941d6-6c42-48c7-8c0d-650b6ac8d933" containerID="0c65372578b6969b794ecf7f0436ef9fa5e55396ac4d88db7e96c6c99ef9ac96" exitCode=0 Jul 02 23:15:08.784523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:08.784525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" event={"ID":"9c3941d6-6c42-48c7-8c0d-650b6ac8d933","Type":"ContainerDied","Data":"0c65372578b6969b794ecf7f0436ef9fa5e55396ac4d88db7e96c6c99ef9ac96"} Jul 02 23:15:09.921257 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:09.921234 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:10.096070 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.095987 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwnnp\" (UniqueName: \"kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp\") pod \"9c3941d6-6c42-48c7-8c0d-650b6ac8d933\" (UID: \"9c3941d6-6c42-48c7-8c0d-650b6ac8d933\") " Jul 02 23:15:10.098148 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.098124 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp" (OuterVolumeSpecName: "kube-api-access-lwnnp") pod "9c3941d6-6c42-48c7-8c0d-650b6ac8d933" (UID: "9c3941d6-6c42-48c7-8c0d-650b6ac8d933"). InnerVolumeSpecName "kube-api-access-lwnnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:15:10.197027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.197001 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwnnp\" (UniqueName: \"kubernetes.io/projected/9c3941d6-6c42-48c7-8c0d-650b6ac8d933-kube-api-access-lwnnp\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:15:10.795108 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.795080 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" Jul 02 23:15:10.795285 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.795125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717235-645lb" event={"ID":"9c3941d6-6c42-48c7-8c0d-650b6ac8d933","Type":"ContainerDied","Data":"a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae"} Jul 02 23:15:10.795285 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:10.795173 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a63d8698b05d1dc42de35ac4a017220a0b181ebd624ce83f2f95ea1d0c0280ae" Jul 02 23:15:14.967856 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:14.967820 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:15:14.968259 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:14.968014 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-679fc747b4-cg2g4" podUID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" containerName="manager" containerID="cri-o://7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91" gracePeriod=30 Jul 02 23:15:15.217366 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.217338 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:15:15.236841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.236785 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert\") pod \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " Jul 02 23:15:15.236841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.236828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxkj8\" (UniqueName: \"kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8\") pod \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\" (UID: \"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87\") " Jul 02 23:15:15.238879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.238852 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8" (OuterVolumeSpecName: "kube-api-access-dxkj8") pod "c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" (UID: "c2ab6fd0-eb33-41f8-80d9-5c411aab7c87"). InnerVolumeSpecName "kube-api-access-dxkj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:15:15.239004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.238855 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" (UID: "c2ab6fd0-eb33-41f8-80d9-5c411aab7c87"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:15:15.337927 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.337903 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxkj8\" (UniqueName: \"kubernetes.io/projected/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-kube-api-access-dxkj8\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:15:15.337927 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.337927 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87-webhook-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:15:15.820324 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.820293 2564 generic.go:356] "Generic (PLEG): container finished" podID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" containerID="7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91" exitCode=0 Jul 02 23:15:15.820476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.820336 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-cg2g4" Jul 02 23:15:15.820476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.820371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-cg2g4" event={"ID":"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87","Type":"ContainerDied","Data":"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91"} Jul 02 23:15:15.820476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.820418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-cg2g4" event={"ID":"c2ab6fd0-eb33-41f8-80d9-5c411aab7c87","Type":"ContainerDied","Data":"d58370941d046096fe8f32e3f51f82bfc3e3d5f52f1954fdaee53c100709512f"} Jul 02 23:15:15.820476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.820442 2564 scope.go:117] "RemoveContainer" containerID="7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91" Jul 02 23:15:15.828824 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.828798 2564 scope.go:117] "RemoveContainer" containerID="7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91" Jul 02 23:15:15.829040 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:15:15.829022 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91\": container with ID starting with 7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91 not found: ID does not exist" containerID="7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91" Jul 02 23:15:15.829099 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.829051 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91"} err="failed to get container status \"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91\": rpc error: code = NotFound desc = could not find container \"7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91\": container with ID starting with 7bb305d08bc8fdf86452d1fc7756d51c194c5862e9c3397b401c102ead2d5c91 not found: ID does not exist" Jul 02 23:15:15.841832 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.841810 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:15:15.843602 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:15.843584 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-679fc747b4-cg2g4"] Jul 02 23:15:16.586089 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586056 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-679fc747b4-r6gzg"] Jul 02 23:15:16.586426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586390 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3941d6-6c42-48c7-8c0d-650b6ac8d933" containerName="cleanup" Jul 02 23:15:16.586426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586400 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3941d6-6c42-48c7-8c0d-650b6ac8d933" containerName="cleanup" Jul 02 23:15:16.586426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586413 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" containerName="manager" Jul 02 23:15:16.586426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586419 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" containerName="manager" Jul 02 23:15:16.586562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586487 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3941d6-6c42-48c7-8c0d-650b6ac8d933" containerName="cleanup" Jul 02 23:15:16.586562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.586494 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" containerName="manager" Jul 02 23:15:16.590836 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.590820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.594734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.594714 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zfkp8\"" Jul 02 23:15:16.594734 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.594727 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 23:15:16.594925 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.594719 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 23:15:16.597499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.597476 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679fc747b4-r6gzg"] Jul 02 23:15:16.648115 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.648093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm2qj\" (UniqueName: \"kubernetes.io/projected/e9168e0e-5b2b-4511-ba21-b226b4a786e3-kube-api-access-vm2qj\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.648223 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.648205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9168e0e-5b2b-4511-ba21-b226b4a786e3-webhook-cert\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.749224 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.749199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9168e0e-5b2b-4511-ba21-b226b4a786e3-webhook-cert\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.749332 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.749242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm2qj\" (UniqueName: \"kubernetes.io/projected/e9168e0e-5b2b-4511-ba21-b226b4a786e3-kube-api-access-vm2qj\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.751626 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.751597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9168e0e-5b2b-4511-ba21-b226b4a786e3-webhook-cert\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.756929 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.756909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm2qj\" (UniqueName: \"kubernetes.io/projected/e9168e0e-5b2b-4511-ba21-b226b4a786e3-kube-api-access-vm2qj\") pod \"maas-controller-679fc747b4-r6gzg\" (UID: \"e9168e0e-5b2b-4511-ba21-b226b4a786e3\") " pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.901691 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.901607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:16.926286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:16.926255 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ab6fd0-eb33-41f8-80d9-5c411aab7c87" path="/var/lib/kubelet/pods/c2ab6fd0-eb33-41f8-80d9-5c411aab7c87/volumes" Jul 02 23:15:17.027511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:17.027488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679fc747b4-r6gzg"] Jul 02 23:15:17.029333 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:15:17.029295 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9168e0e_5b2b_4511_ba21_b226b4a786e3.slice/crio-f37b911624be284782e9adbd11a88e0f8bf9feda1197ae1d823e755e27b579fd WatchSource:0}: Error finding container f37b911624be284782e9adbd11a88e0f8bf9feda1197ae1d823e755e27b579fd: Status 404 returned error can't find the container with id f37b911624be284782e9adbd11a88e0f8bf9feda1197ae1d823e755e27b579fd Jul 02 23:15:17.831256 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:17.831176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-r6gzg" event={"ID":"e9168e0e-5b2b-4511-ba21-b226b4a786e3","Type":"ContainerStarted","Data":"863b036b65e590cb1c8493e99a4f994f2f956c553134123148ff74e7f27e78b1"} Jul 02 23:15:17.831256 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:17.831232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679fc747b4-r6gzg" event={"ID":"e9168e0e-5b2b-4511-ba21-b226b4a786e3","Type":"ContainerStarted","Data":"f37b911624be284782e9adbd11a88e0f8bf9feda1197ae1d823e755e27b579fd"} Jul 02 23:15:17.831606 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:17.831262 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:15:17.849593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:17.849532 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-679fc747b4-r6gzg" podStartSLOduration=1.330580796 podStartE2EDuration="1.84951096s" totalImagesPullingTime="518.930164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:17.846440581 +0000 UTC m=+839.593739689" watchObservedRunningTime="2026-07-02 23:15:17.84951096 +0000 UTC m=+839.596810073" Jul 02 23:15:28.842247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:15:28.842217 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-679fc747b4-r6gzg" Jul 02 23:16:18.739368 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:16:18.739283 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:16:18.742431 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:16:18.742407 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:16:18.743783 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:16:18.743765 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:16:18.747225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:16:18.747207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:21:18.774055 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:21:18.774024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:21:18.774541 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:21:18.774038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:21:18.778767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:21:18.778742 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:21:18.778900 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:21:18.778852 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:26:18.802899 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:26:18.802874 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:26:18.803862 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:26:18.803840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:26:18.807190 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:26:18.807173 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:26:18.808314 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:26:18.808298 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:27:07.659098 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.659053 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:07.662696 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.662652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.665539 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.665518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-227deae5-openshift-default-dockercfg-hksp7\"" Jul 02 23:27:07.688212 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.688191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:07.787285 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787463 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787463 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vwht\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787463 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787463 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787463 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787653 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787653 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.787653 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.787522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888575 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vwht\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.888761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889022 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889022 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889022 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.888858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889169 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.889054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889169 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.889116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889263 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.889222 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889313 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.889291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.889494 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.889472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.891108 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.891086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.891193 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.891142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.896403 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.896381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.896741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.896725 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vwht\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht\") pod \"e2e-ait-227deae5-openshift-default-ccd76655c-gndh9\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:07.972934 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:07.972869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:08.105354 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.105328 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:08.107220 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:27:08.107195 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9b3fdf_49fb_4429_8f7f_98d658ed9cf6.slice/crio-13a6a02e93ed4b8af0f92c4cdfee90d1998b1916224f835a0f547de2cf71fb3e WatchSource:0}: Error finding container 13a6a02e93ed4b8af0f92c4cdfee90d1998b1916224f835a0f547de2cf71fb3e: Status 404 returned error can't find the container with id 13a6a02e93ed4b8af0f92c4cdfee90d1998b1916224f835a0f547de2cf71fb3e Jul 02 23:27:08.109238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.109205 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:08.109316 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.109268 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:08.109316 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.109294 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:08.172533 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.172507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" event={"ID":"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6","Type":"ContainerStarted","Data":"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089"} Jul 02 23:27:08.172629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.172556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" event={"ID":"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6","Type":"ContainerStarted","Data":"13a6a02e93ed4b8af0f92c4cdfee90d1998b1916224f835a0f547de2cf71fb3e"} Jul 02 23:27:08.193101 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.193045 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" podStartSLOduration=1.193028875 podStartE2EDuration="1.193028875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:08.190609112 +0000 UTC m=+1549.937908222" watchObservedRunningTime="2026-07-02 23:27:08.193028875 +0000 UTC m=+1549.940327983" Jul 02 23:27:08.973680 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:08.973626 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:09.978789 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:09.978758 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:10.182129 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:10.182100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:10.182939 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:10.182920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:14.133187 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:14.133153 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:14.133705 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:14.133319 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" podUID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" containerName="istio-proxy" containerID="cri-o://983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089" gracePeriod=30 Jul 02 23:27:19.371828 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.371798 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:19.499428 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499342 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vwht\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499428 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499382 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499428 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499415 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499445 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499475 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499501 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499531 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499586 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.499738 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499618 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs\") pod \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\" (UID: \"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6\") " Jul 02 23:27:19.500032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499768 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:19.500032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499803 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:19.500032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499904 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:19.500032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.499919 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:27:19.500289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500036 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:19.500452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500326 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.500452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500350 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.500452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500365 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.500452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500379 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.500452 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.500391 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.501877 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.501851 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht" (OuterVolumeSpecName: "kube-api-access-5vwht") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "kube-api-access-5vwht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:19.501877 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.501856 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:19.501877 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.501865 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:27:19.502148 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.501971 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" (UID: "bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:19.601133 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.601104 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vwht\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-kube-api-access-5vwht\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.601133 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.601128 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.601133 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.601138 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:19.601321 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:19.601146 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:20.130994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.130959 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:20.131524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.131510 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" containerName="istio-proxy" Jul 02 23:27:20.131574 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.131528 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" containerName="istio-proxy" Jul 02 23:27:20.131619 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.131609 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" containerName="istio-proxy" Jul 02 23:27:20.135078 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.135056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.137723 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.137701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-39d3c2cc-openshift-default-dockercfg-55kxv\"" Jul 02 23:27:20.145878 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.145853 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:20.242758 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.242722 2564 generic.go:356] "Generic (PLEG): container finished" podID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" containerID="983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089" exitCode=0 Jul 02 23:27:20.242930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.242784 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" Jul 02 23:27:20.242930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.242803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" event={"ID":"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6","Type":"ContainerDied","Data":"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089"} Jul 02 23:27:20.242930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.242874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9" event={"ID":"bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6","Type":"ContainerDied","Data":"13a6a02e93ed4b8af0f92c4cdfee90d1998b1916224f835a0f547de2cf71fb3e"} Jul 02 23:27:20.242930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.242896 2564 scope.go:117] "RemoveContainer" containerID="983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089" Jul 02 23:27:20.252240 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.252073 2564 scope.go:117] "RemoveContainer" containerID="983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089" Jul 02 23:27:20.252323 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:27:20.252305 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089\": container with ID starting with 983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089 not found: ID does not exist" containerID="983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089" Jul 02 23:27:20.252367 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.252332 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089"} err="failed to get container status \"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089\": rpc error: code = NotFound desc = could not find container \"983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089\": container with ID starting with 983e133dab7f03daa5023d7d43520ffecb8dc20287e61fbb6052f13c8ebc7089 not found: ID does not exist" Jul 02 23:27:20.266199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.266172 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:20.270153 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.270131 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-227deae5-openshift-default-ccd76655c-gndh9"] Jul 02 23:27:20.306436 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306542 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306542 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2rt\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306542 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306726 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306726 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306792 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306826 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.306826 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.306819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2rt\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.407941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.407940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.408402 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.408079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.408402 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.408353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.409821 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.409800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.409879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.409825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.415621 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.415596 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2rt\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.415838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.415822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token\") pod \"e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.446617 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.446595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:20.577841 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.577816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:20.579780 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:27:20.579751 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0e3d3e_4798_44c5_947c_2afa72704e24.slice/crio-02f311f4a52a0bf24cdddaf4cb7722b7a9ff70f0cdac77c6be01a912e97b89a8 WatchSource:0}: Error finding container 02f311f4a52a0bf24cdddaf4cb7722b7a9ff70f0cdac77c6be01a912e97b89a8: Status 404 returned error can't find the container with id 02f311f4a52a0bf24cdddaf4cb7722b7a9ff70f0cdac77c6be01a912e97b89a8 Jul 02 23:27:20.581995 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.581957 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:20.582064 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.582046 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:20.582103 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.582091 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:20.926774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:20.926736 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6" path="/var/lib/kubelet/pods/bf9b3fdf-49fb-4429-8f7f-98d658ed9cf6/volumes" Jul 02 23:27:21.249864 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:21.249780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerStarted","Data":"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5"} Jul 02 23:27:21.249864 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:21.249831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerStarted","Data":"02f311f4a52a0bf24cdddaf4cb7722b7a9ff70f0cdac77c6be01a912e97b89a8"} Jul 02 23:27:21.269923 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:21.269873 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" podStartSLOduration=1.269859325 podStartE2EDuration="1.269859325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:21.2677749 +0000 UTC m=+1563.015074010" watchObservedRunningTime="2026-07-02 23:27:21.269859325 +0000 UTC m=+1563.017158433" Jul 02 23:27:21.447637 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:21.447607 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:21.452111 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:21.452085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:22.254741 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:22.254703 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:22.255674 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:22.255645 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:32.324807 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.324774 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerID="4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5" exitCode=0 Jul 02 23:27:32.325219 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.324848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerDied","Data":"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5"} Jul 02 23:27:32.325300 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.325277 2564 scope.go:117] "RemoveContainer" containerID="4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5" Jul 02 23:27:32.326286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.326258 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:32.326354 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.326322 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:32.326406 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.326352 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:32.794223 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:32.794188 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:33.331434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:33.331391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerStarted","Data":"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a"} Jul 02 23:27:33.331870 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:33.331437 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" containerID="cri-o://43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a" gracePeriod=30 Jul 02 23:27:37.255236 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:37.255210 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:38.578475 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.578450 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:38.654784 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.654706 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:38.655433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.655382 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:27:38.655433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.655436 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:27:38.655645 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.655618 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:27:38.658859 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.658839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.661338 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.661317 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-50627b1c-openshift-default-dockercfg-rqcnq\"" Jul 02 23:27:38.671757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.671731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:38.676444 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676423 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676547 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676460 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676547 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676486 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw2rt\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676547 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676515 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676724 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676574 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676781 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676720 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:38.676781 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676737 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676812 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.676889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676848 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:38.676889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676856 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.677040 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676871 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:38.677040 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676879 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:27:38.677040 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.676948 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy\") pod \"ae0e3d3e-4798-44c5-947c-2afa72704e24\" (UID: \"ae0e3d3e-4798-44c5-947c-2afa72704e24\") " Jul 02 23:27:38.677312 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.677284 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.677430 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.677316 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae0e3d3e-4798-44c5-947c-2afa72704e24-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.677430 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.677329 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.677430 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.677340 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.677608 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.677582 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:38.679060 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.679026 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:38.679161 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.679105 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt" (OuterVolumeSpecName: "kube-api-access-vw2rt") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "kube-api-access-vw2rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:38.679161 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.679113 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:27:38.679276 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.679228 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae0e3d3e-4798-44c5-947c-2afa72704e24" (UID: "ae0e3d3e-4798-44c5-947c-2afa72704e24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:38.778615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778615 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpx5\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778971 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw2rt\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-kube-api-access-vw2rt\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778982 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.778989 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778991 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.779172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.778998 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.779172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.779006 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae0e3d3e-4798-44c5-947c-2afa72704e24-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:38.879691 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpx5\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.879963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.879959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880286 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.880530 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.880505 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.882268 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.882246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.882507 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.882479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.887388 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.887365 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.887762 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.887746 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpx5\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5\") pod \"e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:38.971925 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:38.971906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:39.108225 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.108199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:39.109956 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:27:39.109929 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc317f6_3f31_4a8f_97a3_78c934cb00ed.slice/crio-6532d6cfe17624c2d47a96f6859e34f42da99fc2a5700cebb6ff848bc194ab37 WatchSource:0}: Error finding container 6532d6cfe17624c2d47a96f6859e34f42da99fc2a5700cebb6ff848bc194ab37: Status 404 returned error can't find the container with id 6532d6cfe17624c2d47a96f6859e34f42da99fc2a5700cebb6ff848bc194ab37 Jul 02 23:27:39.111986 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.111952 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:39.112066 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.112015 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:39.112066 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.112043 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:27:39.363221 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.363180 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerID="43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a" exitCode=0 Jul 02 23:27:39.363405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.363239 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" Jul 02 23:27:39.363405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.363264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerDied","Data":"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a"} Jul 02 23:27:39.363405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.363389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f" event={"ID":"ae0e3d3e-4798-44c5-947c-2afa72704e24","Type":"ContainerDied","Data":"02f311f4a52a0bf24cdddaf4cb7722b7a9ff70f0cdac77c6be01a912e97b89a8"} Jul 02 23:27:39.363572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.363430 2564 scope.go:117] "RemoveContainer" containerID="43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a" Jul 02 23:27:39.365281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.365260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" event={"ID":"fbc317f6-3f31-4a8f-97a3-78c934cb00ed","Type":"ContainerStarted","Data":"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d"} Jul 02 23:27:39.365411 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.365336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" event={"ID":"fbc317f6-3f31-4a8f-97a3-78c934cb00ed","Type":"ContainerStarted","Data":"6532d6cfe17624c2d47a96f6859e34f42da99fc2a5700cebb6ff848bc194ab37"} Jul 02 23:27:39.372128 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.372109 2564 scope.go:117] "RemoveContainer" containerID="4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5" Jul 02 23:27:39.379842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.379824 2564 scope.go:117] "RemoveContainer" containerID="43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a" Jul 02 23:27:39.380113 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:27:39.380093 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a\": container with ID starting with 43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a not found: ID does not exist" containerID="43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a" Jul 02 23:27:39.380165 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.380122 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a"} err="failed to get container status \"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a\": rpc error: code = NotFound desc = could not find container \"43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a\": container with ID starting with 43c08d43168673f95bbfa23e2ce7f1b9663604451aee8c5a0a5ab62df04e972a not found: ID does not exist" Jul 02 23:27:39.380165 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.380137 2564 scope.go:117] "RemoveContainer" containerID="4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5" Jul 02 23:27:39.380364 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:27:39.380350 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5\": container with ID starting with 4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5 not found: ID does not exist" containerID="4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5" Jul 02 23:27:39.380412 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.380366 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5"} err="failed to get container status \"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5\": rpc error: code = NotFound desc = could not find container \"4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5\": container with ID starting with 4b6b9c9ad068762493ee79106efcdbc5a6d7c10319d56f119854247b90d91fe5 not found: ID does not exist" Jul 02 23:27:39.398899 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.398855 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" podStartSLOduration=1.39884152 podStartE2EDuration="1.39884152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:39.398056729 +0000 UTC m=+1581.145355840" watchObservedRunningTime="2026-07-02 23:27:39.39884152 +0000 UTC m=+1581.146140628" Jul 02 23:27:39.427828 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.427793 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:39.433518 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.433497 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-39d3c2cc-openshift-default-86d84bf9-9z85f"] Jul 02 23:27:39.972447 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:39.972420 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:40.925650 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:40.925617 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" path="/var/lib/kubelet/pods/ae0e3d3e-4798-44c5-947c-2afa72704e24/volumes" Jul 02 23:27:40.994633 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:40.994594 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:41.382644 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:41.382613 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:41.383498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:41.383479 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:44.534942 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:44.534906 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:44.535362 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:44.535088 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" podUID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" containerName="istio-proxy" containerID="cri-o://1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d" gracePeriod=30 Jul 02 23:27:49.603546 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.603484 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:49.687553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687460 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687502 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687553 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687536 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kpx5\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687601 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687628 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687739 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687764 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687826 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:27:49.687869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687855 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data\") pod \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\" (UID: \"fbc317f6-3f31-4a8f-97a3-78c934cb00ed\") " Jul 02 23:27:49.688222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687875 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:49.688222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.687990 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:49.688222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688044 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:49.688476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688221 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.688476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688241 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.688476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688255 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.688476 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688267 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.688803 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.688784 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:49.690175 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.690154 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5" (OuterVolumeSpecName: "kube-api-access-5kpx5") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "kube-api-access-5kpx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:49.690247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.690175 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:27:49.690340 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.690324 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:27:49.690394 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.690377 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbc317f6-3f31-4a8f-97a3-78c934cb00ed" (UID: "fbc317f6-3f31-4a8f-97a3-78c934cb00ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:27:49.789328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.789293 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.789328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.789320 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.789328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.789332 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.789531 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.789342 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:49.789531 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:49.789354 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kpx5\" (UniqueName: \"kubernetes.io/projected/fbc317f6-3f31-4a8f-97a3-78c934cb00ed-kube-api-access-5kpx5\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:27:50.432705 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.432648 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" containerID="1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d" exitCode=0 Jul 02 23:27:50.432879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.432716 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" Jul 02 23:27:50.432879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.432740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" event={"ID":"fbc317f6-3f31-4a8f-97a3-78c934cb00ed","Type":"ContainerDied","Data":"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d"} Jul 02 23:27:50.432879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.432794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh" event={"ID":"fbc317f6-3f31-4a8f-97a3-78c934cb00ed","Type":"ContainerDied","Data":"6532d6cfe17624c2d47a96f6859e34f42da99fc2a5700cebb6ff848bc194ab37"} Jul 02 23:27:50.432879 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.432816 2564 scope.go:117] "RemoveContainer" containerID="1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d" Jul 02 23:27:50.442465 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.442448 2564 scope.go:117] "RemoveContainer" containerID="1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d" Jul 02 23:27:50.442708 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:27:50.442691 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d\": container with ID starting with 1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d not found: ID does not exist" containerID="1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d" Jul 02 23:27:50.442761 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.442717 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d"} err="failed to get container status \"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d\": rpc error: code = NotFound desc = could not find container \"1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d\": container with ID starting with 1434aaa90d46bc5227f7fc1a6405d4519b69e8d08cb342efde99bf5d9aa0a22d not found: ID does not exist" Jul 02 23:27:50.454158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.454127 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:50.460629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.460606 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-50627b1c-openshift-default-7fb94d5fd7-bssbh"] Jul 02 23:27:50.926072 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:27:50.926039 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" path="/var/lib/kubelet/pods/fbc317f6-3f31-4a8f-97a3-78c934cb00ed/volumes" Jul 02 23:29:25.165646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.165614 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:25.166112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166001 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:29:25.166112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166012 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:29:25.166112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166029 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" containerName="istio-proxy" Jul 02 23:29:25.166112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166035 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" containerName="istio-proxy" Jul 02 23:29:25.166112 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166110 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc317f6-3f31-4a8f-97a3-78c934cb00ed" containerName="istio-proxy" Jul 02 23:29:25.166284 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.166120 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae0e3d3e-4798-44c5-947c-2afa72704e24" containerName="istio-proxy" Jul 02 23:29:25.169284 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.169265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.172246 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.172227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3265e72b-openshift-default-dockercfg-75ltl\"" Jul 02 23:29:25.192890 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.192869 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:25.242557 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.242750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.242750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.242750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.242750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.242750 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.243026 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.243026 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cbz\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.243026 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.242805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.343955 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.343920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344118 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.343980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344118 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344118 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344118 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344282 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344282 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344282 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cbz\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344282 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344482 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344421 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344496 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344589 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.344904 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.344873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.346496 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.346469 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.346649 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.346635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.352424 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.352396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cbz\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.352754 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.352735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token\") pod \"e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.479349 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.479264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:25.616913 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.616887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:25.618461 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:29:25.618432 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ce76b0_f3e4_47de_892d_ae62e702ea51.slice/crio-139fe90aca120d9e20868b1686c6d016dd7d47ddf8b4643cc50cf61f4eb84b08 WatchSource:0}: Error finding container 139fe90aca120d9e20868b1686c6d016dd7d47ddf8b4643cc50cf61f4eb84b08: Status 404 returned error can't find the container with id 139fe90aca120d9e20868b1686c6d016dd7d47ddf8b4643cc50cf61f4eb84b08 Jul 02 23:29:25.620455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.620421 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:25.620551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.620485 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:25.620551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.620512 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:25.873004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.872972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerStarted","Data":"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390"} Jul 02 23:29:25.873172 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.873043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerStarted","Data":"139fe90aca120d9e20868b1686c6d016dd7d47ddf8b4643cc50cf61f4eb84b08"} Jul 02 23:29:25.891751 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:25.891706 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" podStartSLOduration=0.891692347 podStartE2EDuration="891.692347ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:29:25.891318482 +0000 UTC m=+1687.638617591" watchObservedRunningTime="2026-07-02 23:29:25.891692347 +0000 UTC m=+1687.638991457" Jul 02 23:29:26.479696 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:26.479646 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:26.485281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:26.485253 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:26.877528 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:26.877500 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:26.878468 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:26.878450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:41.878991 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.878956 2564 patch_prober.go:28] interesting pod/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 02 23:29:41.879412 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.879013 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 02 23:29:41.953347 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.953318 2564 generic.go:356] "Generic (PLEG): container finished" podID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerID="7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390" exitCode=0 Jul 02 23:29:41.953504 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.953354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerDied","Data":"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390"} Jul 02 23:29:41.953771 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.953756 2564 scope.go:117] "RemoveContainer" containerID="7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390" Jul 02 23:29:41.954764 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.954734 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:41.954838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.954802 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:41.954878 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:41.954840 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:29:42.959893 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:42.959858 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerStarted","Data":"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398"} Jul 02 23:29:43.480068 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:43.480029 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:43.483836 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:43.483810 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:43.964420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:43.964383 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:43.965415 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:43.965395 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:45.716779 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:45.716747 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:45.974032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:45.973943 2564 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" secret="" err="secret \"e2e-mt-3265e72b-openshift-default-dockercfg-75ltl\" not found" Jul 02 23:29:46.978338 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:46.978300 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" containerID="cri-o://6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398" gracePeriod=30 Jul 02 23:29:52.231191 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.231166 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:52.303510 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303477 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303510 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303513 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303539 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303557 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303689 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4cbz\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303720 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.303777 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303759 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.304104 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303791 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data\") pod \"71ce76b0-f3e4-47de-892d-ae62e702ea51\" (UID: \"71ce76b0-f3e4-47de-892d-ae62e702ea51\") " Jul 02 23:29:52.304104 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303972 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:29:52.304215 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304141 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:29:52.304215 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.303975 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:29:52.304215 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304193 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:29:52.304372 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304303 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.304372 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304323 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce76b0-f3e4-47de-892d-ae62e702ea51-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.304372 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304337 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.304372 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304349 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.304917 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.304890 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data" (OuterVolumeSpecName: "istio-data") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:29:52.305810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.305783 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:29:52.305916 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.305870 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz" (OuterVolumeSpecName: "kube-api-access-q4cbz") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "kube-api-access-q4cbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:29:52.305996 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.305976 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token" (OuterVolumeSpecName: "istio-token") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:29:52.306073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.306052 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71ce76b0-f3e4-47de-892d-ae62e702ea51" (UID: "71ce76b0-f3e4-47de-892d-ae62e702ea51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:29:52.405579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.405543 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.405579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.405573 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.405579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.405584 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.405855 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.405592 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce76b0-f3e4-47de-892d-ae62e702ea51-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:52.405855 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:52.405601 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4cbz\" (UniqueName: \"kubernetes.io/projected/71ce76b0-f3e4-47de-892d-ae62e702ea51-kube-api-access-q4cbz\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:29:53.007909 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.007872 2564 generic.go:356] "Generic (PLEG): container finished" podID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerID="6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398" exitCode=0 Jul 02 23:29:53.008096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.007940 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" Jul 02 23:29:53.008096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.007946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerDied","Data":"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398"} Jul 02 23:29:53.008096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.008025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7" event={"ID":"71ce76b0-f3e4-47de-892d-ae62e702ea51","Type":"ContainerDied","Data":"139fe90aca120d9e20868b1686c6d016dd7d47ddf8b4643cc50cf61f4eb84b08"} Jul 02 23:29:53.008096 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.008046 2564 scope.go:117] "RemoveContainer" containerID="6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398" Jul 02 23:29:53.016630 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.016594 2564 scope.go:117] "RemoveContainer" containerID="7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390" Jul 02 23:29:53.024597 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.024566 2564 scope.go:117] "RemoveContainer" containerID="6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398" Jul 02 23:29:53.024956 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:29:53.024938 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398\": container with ID starting with 6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398 not found: ID does not exist" containerID="6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398" Jul 02 23:29:53.025036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.024964 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398"} err="failed to get container status \"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398\": rpc error: code = NotFound desc = could not find container \"6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398\": container with ID starting with 6b40977ed52076d7f6407c09132f85ffc55ec467eee8e6f9c39ce826e0c7a398 not found: ID does not exist" Jul 02 23:29:53.025036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.024983 2564 scope.go:117] "RemoveContainer" containerID="7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390" Jul 02 23:29:53.025231 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:29:53.025216 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390\": container with ID starting with 7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390 not found: ID does not exist" containerID="7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390" Jul 02 23:29:53.025326 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.025235 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390"} err="failed to get container status \"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390\": rpc error: code = NotFound desc = could not find container \"7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390\": container with ID starting with 7da93829ce493b138357cef819e071c2c80ef01f3ea9f093ef51137b4cddf390 not found: ID does not exist" Jul 02 23:29:53.026639 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.026620 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:53.029791 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:53.029771 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3265e72b-openshift-default-8657784cb7-swnn7"] Jul 02 23:29:54.926344 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:29:54.926311 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" path="/var/lib/kubelet/pods/71ce76b0-f3e4-47de-892d-ae62e702ea51/volumes" Jul 02 23:30:00.127978 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.127944 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-vw7n4"] Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128331 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128343 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128352 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128358 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128413 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.128433 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.128424 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ce76b0-f3e4-47de-892d-ae62e702ea51" containerName="istio-proxy" Jul 02 23:30:00.132842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.132825 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:00.135397 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.135379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mvtr\"" Jul 02 23:30:00.138409 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.138387 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-vw7n4"] Jul 02 23:30:00.269135 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.269098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-299ch\" (UniqueName: \"kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch\") pod \"maas-api-key-cleanup-29717250-vw7n4\" (UID: \"ba6e3061-9643-4cdf-a113-5e172f388bd4\") " pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:00.370499 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.370469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-299ch\" (UniqueName: \"kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch\") pod \"maas-api-key-cleanup-29717250-vw7n4\" (UID: \"ba6e3061-9643-4cdf-a113-5e172f388bd4\") " pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:00.380801 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.380749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-299ch\" (UniqueName: \"kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch\") pod \"maas-api-key-cleanup-29717250-vw7n4\" (UID: \"ba6e3061-9643-4cdf-a113-5e172f388bd4\") " pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:00.444799 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.444773 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:00.572731 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:00.572700 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-vw7n4"] Jul 02 23:30:00.574002 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:30:00.573976 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6e3061_9643_4cdf_a113_5e172f388bd4.slice/crio-ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770 WatchSource:0}: Error finding container ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770: Status 404 returned error can't find the container with id ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770 Jul 02 23:30:01.048288 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:01.048206 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" event={"ID":"ba6e3061-9643-4cdf-a113-5e172f388bd4","Type":"ContainerStarted","Data":"798ef446115fa0b1c8563e0edaef7d107167a4868e4e560341d8398e0ce3887c"} Jul 02 23:30:01.048288 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:01.048268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" event={"ID":"ba6e3061-9643-4cdf-a113-5e172f388bd4","Type":"ContainerStarted","Data":"ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770"} Jul 02 23:30:01.062872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:01.062811 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" podStartSLOduration=1.062794059 podStartE2EDuration="1.062794059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:30:01.062524272 +0000 UTC m=+1722.809823383" watchObservedRunningTime="2026-07-02 23:30:01.062794059 +0000 UTC m=+1722.810093167" Jul 02 23:30:02.054827 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:02.054793 2564 generic.go:356] "Generic (PLEG): container finished" podID="ba6e3061-9643-4cdf-a113-5e172f388bd4" containerID="798ef446115fa0b1c8563e0edaef7d107167a4868e4e560341d8398e0ce3887c" exitCode=0 Jul 02 23:30:02.055230 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:02.054878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" event={"ID":"ba6e3061-9643-4cdf-a113-5e172f388bd4","Type":"ContainerDied","Data":"798ef446115fa0b1c8563e0edaef7d107167a4868e4e560341d8398e0ce3887c"} Jul 02 23:30:03.183758 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:03.183735 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:03.296992 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:03.296963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-299ch\" (UniqueName: \"kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch\") pod \"ba6e3061-9643-4cdf-a113-5e172f388bd4\" (UID: \"ba6e3061-9643-4cdf-a113-5e172f388bd4\") " Jul 02 23:30:03.298927 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:03.298896 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch" (OuterVolumeSpecName: "kube-api-access-299ch") pod "ba6e3061-9643-4cdf-a113-5e172f388bd4" (UID: "ba6e3061-9643-4cdf-a113-5e172f388bd4"). InnerVolumeSpecName "kube-api-access-299ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:30:03.397652 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:03.397593 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-299ch\" (UniqueName: \"kubernetes.io/projected/ba6e3061-9643-4cdf-a113-5e172f388bd4-kube-api-access-299ch\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:30:04.064576 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.064546 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" Jul 02 23:30:04.064765 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.064585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-vw7n4" event={"ID":"ba6e3061-9643-4cdf-a113-5e172f388bd4","Type":"ContainerDied","Data":"ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770"} Jul 02 23:30:04.064765 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.064634 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffb53ff618b8e58072ef371c0de4e9445134ea2d1c4487d74471ae443053f770" Jul 02 23:30:04.960919 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.960885 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:30:04.961419 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.961404 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6e3061-9643-4cdf-a113-5e172f388bd4" containerName="cleanup" Jul 02 23:30:04.961464 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.961423 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6e3061-9643-4cdf-a113-5e172f388bd4" containerName="cleanup" Jul 02 23:30:04.961543 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.961532 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6e3061-9643-4cdf-a113-5e172f388bd4" containerName="cleanup" Jul 02 23:30:04.965032 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.965009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:04.967425 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.967407 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-de78a6e8-openshift-default-dockercfg-fsbqj\"" Jul 02 23:30:04.976527 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:04.976505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:30:05.112959 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.112927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.112959 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.112961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.112995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9c5\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.113365 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.113187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9c5\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.214759 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.215077 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.215077 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.215077 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.214964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.215236 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.215157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.215291 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.215270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.217053 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.217026 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.217185 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.217134 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.225069 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.225042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9c5\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.225178 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.225163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token\") pod \"e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.275950 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.275926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:05.405559 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.405535 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:30:05.407023 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:30:05.406994 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode881f55b_c447_4c1f_bd52_2c9793cb0d75.slice/crio-5488502582ec4a2e5b9b724fb3d4b64e10a6d2f9efff6622e4d9eb3658bde5a8 WatchSource:0}: Error finding container 5488502582ec4a2e5b9b724fb3d4b64e10a6d2f9efff6622e4d9eb3658bde5a8: Status 404 returned error can't find the container with id 5488502582ec4a2e5b9b724fb3d4b64e10a6d2f9efff6622e4d9eb3658bde5a8 Jul 02 23:30:05.409216 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.409184 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:05.409289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.409248 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:05.409289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:05.409276 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:06.075611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:06.075570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerStarted","Data":"ac81edb1316c09fac810869d2f7524a85b8cbe57409624532aa840bb080c0a81"} Jul 02 23:30:06.076016 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:06.075647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerStarted","Data":"5488502582ec4a2e5b9b724fb3d4b64e10a6d2f9efff6622e4d9eb3658bde5a8"} Jul 02 23:30:06.093835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:06.093783 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podStartSLOduration=2.093764757 podStartE2EDuration="2.093764757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:30:06.093055964 +0000 UTC m=+1727.840355082" watchObservedRunningTime="2026-07-02 23:30:06.093764757 +0000 UTC m=+1727.841063866" Jul 02 23:30:06.276429 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:06.276398 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:06.281036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:06.281014 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:07.080705 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:07.080677 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:07.081567 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:07.081542 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:22.082311 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.082276 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 23:30:22.082773 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.082323 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 23:30:22.160059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.160027 2564 generic.go:356] "Generic (PLEG): container finished" podID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerID="ac81edb1316c09fac810869d2f7524a85b8cbe57409624532aa840bb080c0a81" exitCode=0 Jul 02 23:30:22.160215 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.160077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerDied","Data":"ac81edb1316c09fac810869d2f7524a85b8cbe57409624532aa840bb080c0a81"} Jul 02 23:30:22.160459 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.160446 2564 scope.go:117] "RemoveContainer" containerID="ac81edb1316c09fac810869d2f7524a85b8cbe57409624532aa840bb080c0a81" Jul 02 23:30:22.161384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.161357 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:22.161437 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.161424 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:22.161471 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:22.161457 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:30:23.166370 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:23.166337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerStarted","Data":"b740466388e2d97fe4b1bc94ea12cc989d9eea3e2804ca14e4cd31042969c482"} Jul 02 23:30:23.276978 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:23.276935 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:23.277181 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:23.277066 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 23:30:23.277181 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:23.277140 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 23:30:24.276767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:24.276726 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 23:30:24.277271 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:24.276792 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 23:30:25.277310 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:25.277278 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 23:30:25.277905 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:25.277866 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 23:30:26.276617 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:26.276572 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 23:30:26.276839 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:26.276642 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 23:30:27.280661 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:27.280631 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:27.281108 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:27.280908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:30:27.281626 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:30:27.281610 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:31:18.831593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:18.831564 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:31:18.833348 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:18.833328 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:31:18.836168 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:18.836144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:31:18.837925 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:18.837905 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:31:54.459146 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:54.459106 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:31:54.459724 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:54.459366 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" containerID="cri-o://b740466388e2d97fe4b1bc94ea12cc989d9eea3e2804ca14e4cd31042969c482" gracePeriod=30 Jul 02 23:31:57.283413 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:57.283369 2564 patch_prober.go:28] interesting pod/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 23:31:57.283913 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:57.283462 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:31:59.637828 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.637797 2564 generic.go:356] "Generic (PLEG): container finished" podID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerID="b740466388e2d97fe4b1bc94ea12cc989d9eea3e2804ca14e4cd31042969c482" exitCode=0 Jul 02 23:31:59.638219 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.637871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerDied","Data":"b740466388e2d97fe4b1bc94ea12cc989d9eea3e2804ca14e4cd31042969c482"} Jul 02 23:31:59.638219 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.637934 2564 scope.go:117] "RemoveContainer" containerID="ac81edb1316c09fac810869d2f7524a85b8cbe57409624532aa840bb080c0a81" Jul 02 23:31:59.710347 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.710317 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:31:59.763645 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763546 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763645 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763592 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763645 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763629 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763687 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763802 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763823 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763850 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t9c5\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.763951 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763939 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket\") pod \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\" (UID: \"e881f55b-c447-4c1f-bd52-2c9793cb0d75\") " Jul 02 23:31:59.764244 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.763951 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:31:59.764244 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764144 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:31:59.764384 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764364 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:31:59.764448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764376 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:31:59.764448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764403 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.764448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764424 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.764563 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.764461 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data" (OuterVolumeSpecName: "istio-data") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:31:59.766000 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.765972 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token" (OuterVolumeSpecName: "istio-token") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:31:59.766108 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.766000 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5" (OuterVolumeSpecName: "kube-api-access-6t9c5") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "kube-api-access-6t9c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:31:59.766197 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.766176 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:31:59.766288 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.766268 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e881f55b-c447-4c1f-bd52-2c9793cb0d75" (UID: "e881f55b-c447-4c1f-bd52-2c9793cb0d75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:31:59.865247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865207 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865245 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865253 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865262 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t9c5\" (UniqueName: \"kubernetes.io/projected/e881f55b-c447-4c1f-bd52-2c9793cb0d75-kube-api-access-6t9c5\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865493 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865273 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865493 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865281 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:31:59.865493 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:31:59.865289 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e881f55b-c447-4c1f-bd52-2c9793cb0d75-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:32:00.643401 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.643370 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" Jul 02 23:32:00.643973 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.643407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8" event={"ID":"e881f55b-c447-4c1f-bd52-2c9793cb0d75","Type":"ContainerDied","Data":"5488502582ec4a2e5b9b724fb3d4b64e10a6d2f9efff6622e4d9eb3658bde5a8"} Jul 02 23:32:00.643973 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.643466 2564 scope.go:117] "RemoveContainer" containerID="b740466388e2d97fe4b1bc94ea12cc989d9eea3e2804ca14e4cd31042969c482" Jul 02 23:32:00.669342 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.669314 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:32:00.677317 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.677292 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-de78a6e8-openshift-default-6ffcd7bb4c-z2nc8"] Jul 02 23:32:00.925448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:00.925368 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" path="/var/lib/kubelet/pods/e881f55b-c447-4c1f-bd52-2c9793cb0d75/volumes" Jul 02 23:32:48.601993 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.601906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:32:48.602526 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.602468 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:48.602526 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.602490 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:48.602654 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.602613 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:48.602654 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.602627 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:48.605626 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.605608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.608157 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.608136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b0517f-openshift-default-dockercfg-r42mm\"" Jul 02 23:32:48.616462 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.616438 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:32:48.724209 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzjb\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.724562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.724536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.825936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.825900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzjb\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.825936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.825943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826199 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826469 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826469 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826716 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826721 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.826883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826813 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.827069 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.826946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.827485 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.827461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.828641 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.828617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.828997 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.828976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.834114 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.834092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.834281 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.834262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzjb\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb\") pod \"e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:48.916699 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:48.916593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:49.052126 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.052104 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:32:49.053629 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:32:49.053602 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe173a6_7fe4_4647_89f2_e966653478fb.slice/crio-1b35100dde56951fe9943ba24c00aa72a395e45f62292a03a6b621cabb62a3f3 WatchSource:0}: Error finding container 1b35100dde56951fe9943ba24c00aa72a395e45f62292a03a6b621cabb62a3f3: Status 404 returned error can't find the container with id 1b35100dde56951fe9943ba24c00aa72a395e45f62292a03a6b621cabb62a3f3 Jul 02 23:32:49.056189 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.056153 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:49.056280 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.056218 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:49.056280 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.056246 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:49.879557 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.879517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerStarted","Data":"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0"} Jul 02 23:32:49.880016 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.879608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerStarted","Data":"1b35100dde56951fe9943ba24c00aa72a395e45f62292a03a6b621cabb62a3f3"} Jul 02 23:32:49.898849 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.898791 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podStartSLOduration=1.898773363 podStartE2EDuration="1.898773363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:49.897866538 +0000 UTC m=+1891.645165652" watchObservedRunningTime="2026-07-02 23:32:49.898773363 +0000 UTC m=+1891.646072473" Jul 02 23:32:49.916934 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:49.916905 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:50.925921 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:50.925896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:51.890605 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:51.890568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:51.891751 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:51.891725 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:32:56.962690 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.962642 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:32:56.963104 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.963037 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:56.963104 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.963050 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e881f55b-c447-4c1f-bd52-2c9793cb0d75" containerName="istio-proxy" Jul 02 23:32:56.966504 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.966467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:56.968959 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.968936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0ae6cc-openshift-default-dockercfg-wpg4p\"" Jul 02 23:32:56.979922 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:56.979893 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:32:57.102898 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.102864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.102898 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.102907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.102947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbpc\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103130 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.103262 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.103196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.203781 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.203781 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbpc\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.203971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204385 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204439 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204439 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204544 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.204630 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.204586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.206718 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.206658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.206829 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.206784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.212681 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.212643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.213066 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.213024 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbpc\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc\") pod \"e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.280036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.279998 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:57.425678 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.425636 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:32:57.427634 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:32:57.427606 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470e2e9d_d539_4764_816b_88a6e98df007.slice/crio-9074fa6a241b2d2bdaa1a9e464a00015a4ffac990c207c0445f0f653bbac1915 WatchSource:0}: Error finding container 9074fa6a241b2d2bdaa1a9e464a00015a4ffac990c207c0445f0f653bbac1915: Status 404 returned error can't find the container with id 9074fa6a241b2d2bdaa1a9e464a00015a4ffac990c207c0445f0f653bbac1915 Jul 02 23:32:57.429797 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.429765 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:57.429882 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.429829 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:57.429882 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.429856 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:32:57.920808 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.920766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerStarted","Data":"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965"} Jul 02 23:32:57.920981 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.920824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerStarted","Data":"9074fa6a241b2d2bdaa1a9e464a00015a4ffac990c207c0445f0f653bbac1915"} Jul 02 23:32:57.944087 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:57.944017 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podStartSLOduration=1.9439992720000001 podStartE2EDuration="1.943999272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:57.940809487 +0000 UTC m=+1899.688108598" watchObservedRunningTime="2026-07-02 23:32:57.943999272 +0000 UTC m=+1899.691298382" Jul 02 23:32:58.281093 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:58.281056 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:58.286107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:58.286073 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:58.926359 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:58.926322 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:32:58.927193 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:32:58.927171 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:33:07.020695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.019800 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:48596->10.132.0.43:15021: read: connection reset by peer" start-of-body= Jul 02 23:33:07.020695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.019892 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:48596->10.132.0.43:15021: read: connection reset by peer" Jul 02 23:33:07.976745 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.976706 2564 generic.go:356] "Generic (PLEG): container finished" podID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerID="10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0" exitCode=0 Jul 02 23:33:07.976953 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.976795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerDied","Data":"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0"} Jul 02 23:33:07.977328 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.977299 2564 scope.go:117] "RemoveContainer" containerID="10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0" Jul 02 23:33:07.979488 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.979448 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:07.979785 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.979758 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:07.979958 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:07.979938 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:08.986875 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:08.986841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerStarted","Data":"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271"} Jul 02 23:33:09.918051 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:09.918003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:33:09.918287 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:09.918148 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 02 23:33:09.918287 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:09.918231 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 02 23:33:10.917392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:10.917347 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 02 23:33:10.917869 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:10.917411 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 02 23:33:11.917197 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:11.917158 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 02 23:33:11.917377 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:11.917217 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 02 23:33:12.917633 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:12.917591 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 02 23:33:12.918052 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:12.917689 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 02 23:33:13.921515 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:13.921486 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:33:13.922012 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:13.921896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:33:13.922522 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:13.922502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:33:14.290166 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:14.289724 2564 patch_prober.go:28] interesting pod/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:38804->10.132.0.44:15021: read: connection reset by peer" start-of-body= Jul 02 23:33:14.290166 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:14.289810 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:38804->10.132.0.44:15021: read: connection reset by peer" Jul 02 23:33:15.025247 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.025215 2564 generic.go:356] "Generic (PLEG): container finished" podID="470e2e9d-d539-4764-816b-88a6e98df007" containerID="5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965" exitCode=0 Jul 02 23:33:15.025641 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.025286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerDied","Data":"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965"} Jul 02 23:33:15.025825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.025808 2564 scope.go:117] "RemoveContainer" containerID="5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965" Jul 02 23:33:15.026793 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.026762 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:15.026858 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.026844 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:15.026907 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:15.026890 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:33:16.032150 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:16.032113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerStarted","Data":"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f"} Jul 02 23:33:16.280470 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:16.280429 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:33:16.280737 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:16.280705 2564 patch_prober.go:28] interesting pod/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 23:33:16.280826 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:16.280768 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 23:33:17.281512 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:17.281072 2564 patch_prober.go:28] interesting pod/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 23:33:17.281512 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:17.281146 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 23:33:18.280715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:18.280652 2564 patch_prober.go:28] interesting pod/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 23:33:18.280917 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:18.280747 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 23:33:19.281036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:19.281001 2564 patch_prober.go:28] interesting pod/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 02 23:33:19.281593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:19.281069 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 02 23:33:20.283998 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:20.283970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:33:20.284439 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:20.284237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:33:20.284849 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:33:20.284831 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:35:21.924709 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:21.924653 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:35:21.925255 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:21.924925 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" containerID="cri-o://c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271" gracePeriod=30 Jul 02 23:35:27.177260 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.177235 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:35:27.246053 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.245989 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246053 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246034 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246053 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246053 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246080 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tzjb\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246165 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246209 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246288 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:27.246537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246305 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs\") pod \"3fe173a6-7fe4-4647-89f2-e966653478fb\" (UID: \"3fe173a6-7fe4-4647-89f2-e966653478fb\") " Jul 02 23:35:27.246537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246514 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:27.246771 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246740 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.246771 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246746 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:27.246771 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.246762 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.247467 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.247433 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:27.247564 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.247539 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:35:27.248289 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.248261 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb" (OuterVolumeSpecName: "kube-api-access-6tzjb") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "kube-api-access-6tzjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:27.248374 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.248289 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:35:27.248374 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.248352 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:27.248626 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.248377 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fe173a6-7fe4-4647-89f2-e966653478fb" (UID: "3fe173a6-7fe4-4647-89f2-e966653478fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:27.347453 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347430 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347453 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347451 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347460 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347469 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tzjb\" (UniqueName: \"kubernetes.io/projected/3fe173a6-7fe4-4647-89f2-e966653478fb-kube-api-access-6tzjb\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347477 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347485 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fe173a6-7fe4-4647-89f2-e966653478fb-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.347572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.347492 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fe173a6-7fe4-4647-89f2-e966653478fb-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:27.695436 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.695410 2564 generic.go:356] "Generic (PLEG): container finished" podID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerID="c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271" exitCode=0 Jul 02 23:35:27.695549 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.695479 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" Jul 02 23:35:27.695549 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.695484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerDied","Data":"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271"} Jul 02 23:35:27.695549 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.695533 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb" event={"ID":"3fe173a6-7fe4-4647-89f2-e966653478fb","Type":"ContainerDied","Data":"1b35100dde56951fe9943ba24c00aa72a395e45f62292a03a6b621cabb62a3f3"} Jul 02 23:35:27.695686 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.695557 2564 scope.go:117] "RemoveContainer" containerID="c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271" Jul 02 23:35:27.705043 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.705015 2564 scope.go:117] "RemoveContainer" containerID="10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0" Jul 02 23:35:27.713149 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.713132 2564 scope.go:117] "RemoveContainer" containerID="c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271" Jul 02 23:35:27.713371 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:35:27.713354 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271\": container with ID starting with c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271 not found: ID does not exist" containerID="c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271" Jul 02 23:35:27.713434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.713376 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271"} err="failed to get container status \"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271\": rpc error: code = NotFound desc = could not find container \"c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271\": container with ID starting with c6f7be3725a5bf88849463a3e3a58f233766551070cd824ea91ce8b91a532271 not found: ID does not exist" Jul 02 23:35:27.713434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.713397 2564 scope.go:117] "RemoveContainer" containerID="10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0" Jul 02 23:35:27.713611 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:35:27.713597 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0\": container with ID starting with 10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0 not found: ID does not exist" containerID="10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0" Jul 02 23:35:27.713652 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.713615 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0"} err="failed to get container status \"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0\": rpc error: code = NotFound desc = could not find container \"10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0\": container with ID starting with 10adea6cc5430e0e4ecee39dc5689d0c8f21f184bf5fc7c23799c0686c1f83e0 not found: ID does not exist" Jul 02 23:35:27.717939 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.717918 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:35:27.722023 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:27.722003 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b0517f-openshift-default-7c8cdcdc6c-wthrb"] Jul 02 23:35:28.746920 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:28.746889 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:35:28.747340 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:28.747089 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" containerID="cri-o://729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f" gracePeriod=30 Jul 02 23:35:28.926582 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:28.926550 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" path="/var/lib/kubelet/pods/3fe173a6-7fe4-4647-89f2-e966653478fb/volumes" Jul 02 23:35:29.602249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602219 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:35:29.602629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602610 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.602629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602629 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.602830 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602655 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.602830 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602676 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.602830 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602774 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.602830 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.602790 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe173a6-7fe4-4647-89f2-e966653478fb" containerName="istio-proxy" Jul 02 23:35:29.607105 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.607087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.609502 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.609486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b797b8-openshift-default-dockercfg-5gkdj\"" Jul 02 23:35:29.617259 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.617233 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:35:29.666409 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666522 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666522 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66f4\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666740 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666740 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666740 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.666740 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.666724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767220 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.767713 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66f4\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.768152 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.768152 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.768152 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.768152 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.767967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.768372 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.768305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.769597 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.769580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.770237 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.770212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.775508 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.775482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66f4\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.775659 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.775639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token\") pod \"e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:29.918579 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:29.918515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:30.049923 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.049900 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:35:30.051800 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:35:30.051771 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade3bbb3_e1d2_4a79_b8b8_0061b6c7acfc.slice/crio-a80ef0cc4d74c4a80f632c2f8f19e2400d9a57cc514c431378f6a00f7e056c2d WatchSource:0}: Error finding container a80ef0cc4d74c4a80f632c2f8f19e2400d9a57cc514c431378f6a00f7e056c2d: Status 404 returned error can't find the container with id a80ef0cc4d74c4a80f632c2f8f19e2400d9a57cc514c431378f6a00f7e056c2d Jul 02 23:35:30.053936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.053894 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:30.054031 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.053984 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:30.054068 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.054025 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:30.715622 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.715589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerStarted","Data":"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a"} Jul 02 23:35:30.715806 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.715637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerStarted","Data":"a80ef0cc4d74c4a80f632c2f8f19e2400d9a57cc514c431378f6a00f7e056c2d"} Jul 02 23:35:30.737160 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.737109 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podStartSLOduration=1.737092188 podStartE2EDuration="1.737092188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:30.735932013 +0000 UTC m=+2052.483231123" watchObservedRunningTime="2026-07-02 23:35:30.737092188 +0000 UTC m=+2052.484391299" Jul 02 23:35:30.919296 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:30.919266 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:31.924387 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:31.924360 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:32.728392 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:32.728356 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:32.729364 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:32.729341 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:34.004642 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.004618 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:35:34.105444 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105412 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105592 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105464 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105592 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105572 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105735 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105604 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105735 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105688 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105735 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105697 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:34.105735 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105713 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105787 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbpc\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105821 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.105954 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.105852 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy\") pod \"470e2e9d-d539-4764-816b-88a6e98df007\" (UID: \"470e2e9d-d539-4764-816b-88a6e98df007\") " Jul 02 23:35:34.106107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106083 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:34.106196 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106160 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:34.106266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106238 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.106266 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106256 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.106404 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106270 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.106484 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106462 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:35:34.106794 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.106773 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data" (OuterVolumeSpecName: "istio-data") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:34.108092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.108072 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token" (OuterVolumeSpecName: "istio-token") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:34.108327 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.108302 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc" (OuterVolumeSpecName: "kube-api-access-sqbpc") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "kube-api-access-sqbpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:34.108417 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.108346 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:35:34.108505 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.108486 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "470e2e9d-d539-4764-816b-88a6e98df007" (UID: "470e2e9d-d539-4764-816b-88a6e98df007"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:34.206700 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206651 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqbpc\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-kube-api-access-sqbpc\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.206700 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206698 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470e2e9d-d539-4764-816b-88a6e98df007-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.206844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206709 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.206844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206716 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470e2e9d-d539-4764-816b-88a6e98df007-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.206844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206724 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470e2e9d-d539-4764-816b-88a6e98df007-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.206844 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.206730 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470e2e9d-d539-4764-816b-88a6e98df007-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:35:34.739692 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.739631 2564 generic.go:356] "Generic (PLEG): container finished" podID="470e2e9d-d539-4764-816b-88a6e98df007" containerID="729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f" exitCode=0 Jul 02 23:35:34.739872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.739707 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" Jul 02 23:35:34.739872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.739716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerDied","Data":"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f"} Jul 02 23:35:34.739872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.739794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x" event={"ID":"470e2e9d-d539-4764-816b-88a6e98df007","Type":"ContainerDied","Data":"9074fa6a241b2d2bdaa1a9e464a00015a4ffac990c207c0445f0f653bbac1915"} Jul 02 23:35:34.739872 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.739817 2564 scope.go:117] "RemoveContainer" containerID="729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f" Jul 02 23:35:34.749846 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.749830 2564 scope.go:117] "RemoveContainer" containerID="5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965" Jul 02 23:35:34.757819 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.757804 2564 scope.go:117] "RemoveContainer" containerID="729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f" Jul 02 23:35:34.758067 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:35:34.758049 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f\": container with ID starting with 729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f not found: ID does not exist" containerID="729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f" Jul 02 23:35:34.758107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.758076 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f"} err="failed to get container status \"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f\": rpc error: code = NotFound desc = could not find container \"729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f\": container with ID starting with 729a43316379be7e003302dcc72d4b586d3bc214a7cc6261550cde2141ddb16f not found: ID does not exist" Jul 02 23:35:34.758107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.758093 2564 scope.go:117] "RemoveContainer" containerID="5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965" Jul 02 23:35:34.758309 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:35:34.758293 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965\": container with ID starting with 5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965 not found: ID does not exist" containerID="5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965" Jul 02 23:35:34.758349 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.758316 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965"} err="failed to get container status \"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965\": rpc error: code = NotFound desc = could not find container \"5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965\": container with ID starting with 5df0af2d8aaa477c12e9930fc88bb0de766cfa02069a0cf22257e28ea6f15965 not found: ID does not exist" Jul 02 23:35:34.762125 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.762103 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:35:34.765725 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.765704 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0ae6cc-openshift-default-f878c4687-8wt5x"] Jul 02 23:35:34.926185 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:34.926161 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470e2e9d-d539-4764-816b-88a6e98df007" path="/var/lib/kubelet/pods/470e2e9d-d539-4764-816b-88a6e98df007/volumes" Jul 02 23:35:37.931509 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931473 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:35:37.931875 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931862 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:35:37.931931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931876 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:35:37.931931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931888 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:35:37.931931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931894 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:35:37.932031 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.931945 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:35:37.937094 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.937070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:37.939652 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.939634 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-782a03-openshift-default-dockercfg-8wp8l\"" Jul 02 23:35:37.947915 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:37.947893 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:35:38.037978 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.037950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038357 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038357 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038357 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038357 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq6cl\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.038562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.038385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139297 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq6cl\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139715 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.139953 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139809 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.140016 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.140016 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.139994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.140258 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.140237 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.141776 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.141754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.141932 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.141916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.149919 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.149897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.150176 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.150154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq6cl\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl\") pod \"e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.247900 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.247819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:38.382551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.382523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:35:38.384308 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:35:38.384283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66922c48_dfb6_4af3_af44_623fb6fff1b1.slice/crio-1d2428d00a81acd6bedf117abce12977b953745c7625bdb86b26b6b4e218bfa4 WatchSource:0}: Error finding container 1d2428d00a81acd6bedf117abce12977b953745c7625bdb86b26b6b4e218bfa4: Status 404 returned error can't find the container with id 1d2428d00a81acd6bedf117abce12977b953745c7625bdb86b26b6b4e218bfa4 Jul 02 23:35:38.386893 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.386859 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:38.387000 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.386924 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:38.387000 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.386952 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:38.763331 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.763296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerStarted","Data":"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae"} Jul 02 23:35:38.763480 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.763349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerStarted","Data":"1d2428d00a81acd6bedf117abce12977b953745c7625bdb86b26b6b4e218bfa4"} Jul 02 23:35:38.791409 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:38.791328 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podStartSLOduration=1.791306159 podStartE2EDuration="1.791306159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:38.787006049 +0000 UTC m=+2060.534305159" watchObservedRunningTime="2026-07-02 23:35:38.791306159 +0000 UTC m=+2060.538605269" Jul 02 23:35:39.248235 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:39.248203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:39.253559 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:39.253535 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:39.767931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:39.767901 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:39.768767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:39.768743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:45.805321 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.805286 2564 generic.go:356] "Generic (PLEG): container finished" podID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerID="583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a" exitCode=0 Jul 02 23:35:45.805767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.805361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerDied","Data":"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a"} Jul 02 23:35:45.805822 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.805782 2564 scope.go:117] "RemoveContainer" containerID="583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a" Jul 02 23:35:45.806724 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.806698 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:45.806802 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.806768 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:45.806802 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:45.806798 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:46.815754 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:46.815714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerStarted","Data":"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25"} Jul 02 23:35:46.919571 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:46.919527 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:46.920892 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:46.920857 2564 patch_prober.go:28] interesting pod/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 02 23:35:46.921021 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:46.920932 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 02 23:35:47.728509 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:47.728473 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:47.918838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:47.918802 2564 patch_prober.go:28] interesting pod/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 02 23:35:47.919198 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:47.918851 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 02 23:35:48.919710 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:48.919643 2564 patch_prober.go:28] interesting pod/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 02 23:35:48.920223 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:48.919732 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 02 23:35:49.919458 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:49.919412 2564 patch_prober.go:28] interesting pod/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 02 23:35:49.919684 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:49.919479 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 02 23:35:50.931119 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:50.931085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:50.932147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:50.932125 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:35:54.907447 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:54.906420 2564 patch_prober.go:28] interesting pod/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:57110->10.132.0.46:15021: read: connection reset by peer" start-of-body= Jul 02 23:35:54.907447 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:54.906477 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:57110->10.132.0.46:15021: read: connection reset by peer" Jul 02 23:35:55.864419 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.864382 2564 generic.go:356] "Generic (PLEG): container finished" podID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerID="7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae" exitCode=0 Jul 02 23:35:55.864600 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.864452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerDied","Data":"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae"} Jul 02 23:35:55.864851 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.864836 2564 scope.go:117] "RemoveContainer" containerID="7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae" Jul 02 23:35:55.865838 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.865810 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:55.865911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.865882 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:55.865952 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:55.865913 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:35:56.871593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:56.871562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerStarted","Data":"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184"} Jul 02 23:35:57.249044 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:57.248954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:35:57.249198 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:57.249149 2564 patch_prober.go:28] interesting pod/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 23:35:57.249239 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:57.249194 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 23:35:58.248988 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:58.248952 2564 patch_prober.go:28] interesting pod/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 23:35:58.249382 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:58.249014 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 23:35:59.249122 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:59.249090 2564 patch_prober.go:28] interesting pod/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 23:35:59.249488 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:59.249140 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 23:35:59.605584 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:59.605547 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:35:59.605805 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:35:59.605788 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" containerID="cri-o://8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25" gracePeriod=30 Jul 02 23:36:00.248230 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:00.248200 2564 patch_prober.go:28] interesting pod/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 23:36:00.248405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:00.248265 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 23:36:01.251818 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:01.251783 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:36:01.252264 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:01.252081 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:36:01.252788 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:01.252772 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:36:04.860116 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.860090 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:36:04.896963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.896903 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.896963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.896942 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.896974 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k66f4\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897020 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897039 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897060 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897084 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897145 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897197 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket\") pod \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\" (UID: \"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc\") " Jul 02 23:36:04.897448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897269 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:04.897448 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897331 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:36:04.897593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897517 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.897593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897536 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.897903 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897877 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:04.898010 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.897979 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:04.898074 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.898009 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:04.899527 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.899483 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:04.899835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.899805 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:36:04.899941 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.899903 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4" (OuterVolumeSpecName: "kube-api-access-k66f4") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "kube-api-access-k66f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:04.900097 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.900079 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" (UID: "ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:04.922605 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.919786 2564 generic.go:356] "Generic (PLEG): container finished" podID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerID="8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25" exitCode=0 Jul 02 23:36:04.922605 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.919942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" Jul 02 23:36:04.928632 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.928606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerDied","Data":"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25"} Jul 02 23:36:04.928757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.928652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd" event={"ID":"ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc","Type":"ContainerDied","Data":"a80ef0cc4d74c4a80f632c2f8f19e2400d9a57cc514c431378f6a00f7e056c2d"} Jul 02 23:36:04.928757 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.928687 2564 scope.go:117] "RemoveContainer" containerID="8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25" Jul 02 23:36:04.937000 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.936948 2564 scope.go:117] "RemoveContainer" containerID="583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a" Jul 02 23:36:04.945090 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.945004 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:36:04.945167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.945148 2564 scope.go:117] "RemoveContainer" containerID="8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25" Jul 02 23:36:04.945431 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:36:04.945414 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25\": container with ID starting with 8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25 not found: ID does not exist" containerID="8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25" Jul 02 23:36:04.945480 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.945439 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25"} err="failed to get container status \"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25\": rpc error: code = NotFound desc = could not find container \"8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25\": container with ID starting with 8445570ff768fc2d5b16eea8a1a1a2d2451bf5cfa2332d2894921047213f7b25 not found: ID does not exist" Jul 02 23:36:04.945480 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.945455 2564 scope.go:117] "RemoveContainer" containerID="583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a" Jul 02 23:36:04.945718 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:36:04.945657 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a\": container with ID starting with 583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a not found: ID does not exist" containerID="583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a" Jul 02 23:36:04.945834 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.945728 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a"} err="failed to get container status \"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a\": rpc error: code = NotFound desc = could not find container \"583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a\": container with ID starting with 583b1d634496c6f11b64002d28c0f9c333e8c320e54138d148ebd4c2417bd66a not found: ID does not exist" Jul 02 23:36:04.946961 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.946940 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b797b8-openshift-default-694b9449cc-ptpdd"] Jul 02 23:36:04.998467 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998444 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998467 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998468 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998478 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998486 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998494 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998505 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:04.998635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:04.998518 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k66f4\" (UniqueName: \"kubernetes.io/projected/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc-kube-api-access-k66f4\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:06.300530 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:06.300499 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:36:06.300993 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:06.300785 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" containerID="cri-o://041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184" gracePeriod=30 Jul 02 23:36:06.926903 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:06.926861 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" path="/var/lib/kubelet/pods/ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc/volumes" Jul 02 23:36:07.123333 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123300 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:36:07.123767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123745 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.123767 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123766 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.123994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123778 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.123994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123786 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.123994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123894 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="470e2e9d-d539-4764-816b-88a6e98df007" containerName="istio-proxy" Jul 02 23:36:07.123994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123906 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.123994 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.123914 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade3bbb3-e1d2-4a79-b8b8-0061b6c7acfc" containerName="istio-proxy" Jul 02 23:36:07.128638 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.128616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.131121 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.131101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9352c3-openshift-default-dockercfg-b2wtf\"" Jul 02 23:36:07.138936 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.138915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:36:07.215414 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215414 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215414 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215706 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.215971 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.215779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fj8\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.316660 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.316660 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316704 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317203 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.316994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fj8\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.317229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.317289 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.317344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.317468 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.317629 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.317519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.319546 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.319522 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.319722 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.319707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.324485 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.324464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.324720 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.324702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fj8\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8\") pod \"e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.439817 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.439790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:07.569197 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.569159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:36:07.572502 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:36:07.572471 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25c26a3_2625_4aec_a2c5_c572632f4607.slice/crio-8db9f7f448a8fd7d407f37a652123f26e5a4011e7e38d63adde1c135de1cd5c2 WatchSource:0}: Error finding container 8db9f7f448a8fd7d407f37a652123f26e5a4011e7e38d63adde1c135de1cd5c2: Status 404 returned error can't find the container with id 8db9f7f448a8fd7d407f37a652123f26e5a4011e7e38d63adde1c135de1cd5c2 Jul 02 23:36:07.574796 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.574760 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:07.574891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.574830 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:07.574891 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.574859 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:07.937376 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.937337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerStarted","Data":"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140"} Jul 02 23:36:07.937551 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.937397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerStarted","Data":"8db9f7f448a8fd7d407f37a652123f26e5a4011e7e38d63adde1c135de1cd5c2"} Jul 02 23:36:07.958816 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:07.958771 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podStartSLOduration=0.958755936 podStartE2EDuration="958.755936ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:36:07.956476501 +0000 UTC m=+2089.703775633" watchObservedRunningTime="2026-07-02 23:36:07.958755936 +0000 UTC m=+2089.706055044" Jul 02 23:36:08.440446 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:08.440417 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:08.445249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:08.445225 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:08.941431 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:08.941404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:08.942295 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:08.942274 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:11.567637 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.567579 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:36:11.656004 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.655974 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656149 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656037 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656149 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656086 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656149 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656124 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656290 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656160 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656290 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656232 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656290 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656256 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656290 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656278 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:11.656475 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656326 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:11.656475 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656423 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq6cl\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656585 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656473 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token\") pod \"66922c48-dfb6-4af3-af44-623fb6fff1b1\" (UID: \"66922c48-dfb6-4af3-af44-623fb6fff1b1\") " Jul 02 23:36:11.656585 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656487 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:11.656585 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:36:11.656857 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656835 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.656857 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656858 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.657078 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656868 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66922c48-dfb6-4af3-af44-623fb6fff1b1-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.657078 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.656879 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.657190 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.657124 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:11.658444 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.658410 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:11.658555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.658452 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:36:11.658555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.658482 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl" (OuterVolumeSpecName: "kube-api-access-zq6cl") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "kube-api-access-zq6cl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:11.658555 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.658496 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "66922c48-dfb6-4af3-af44-623fb6fff1b1" (UID: "66922c48-dfb6-4af3-af44-623fb6fff1b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:11.757821 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.757791 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.757821 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.757819 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.757821 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.757828 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.757992 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.757837 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq6cl\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-kube-api-access-zq6cl\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.757992 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.757847 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66922c48-dfb6-4af3-af44-623fb6fff1b1-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:36:11.957027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.956966 2564 generic.go:356] "Generic (PLEG): container finished" podID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerID="041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184" exitCode=0 Jul 02 23:36:11.957027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.956995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerDied","Data":"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184"} Jul 02 23:36:11.957027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.957014 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" Jul 02 23:36:11.957195 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.957045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8" event={"ID":"66922c48-dfb6-4af3-af44-623fb6fff1b1","Type":"ContainerDied","Data":"1d2428d00a81acd6bedf117abce12977b953745c7625bdb86b26b6b4e218bfa4"} Jul 02 23:36:11.957195 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.957066 2564 scope.go:117] "RemoveContainer" containerID="041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184" Jul 02 23:36:11.966636 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.966621 2564 scope.go:117] "RemoveContainer" containerID="7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae" Jul 02 23:36:11.974484 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.974469 2564 scope.go:117] "RemoveContainer" containerID="041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184" Jul 02 23:36:11.974737 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:36:11.974718 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184\": container with ID starting with 041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184 not found: ID does not exist" containerID="041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184" Jul 02 23:36:11.974803 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.974744 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184"} err="failed to get container status \"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184\": rpc error: code = NotFound desc = could not find container \"041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184\": container with ID starting with 041ec6d77f2f7f647e629b28c52eed942c32ad3a32a82ac67fc54d94064a0184 not found: ID does not exist" Jul 02 23:36:11.974803 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.974760 2564 scope.go:117] "RemoveContainer" containerID="7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae" Jul 02 23:36:11.974998 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:36:11.974981 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae\": container with ID starting with 7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae not found: ID does not exist" containerID="7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae" Jul 02 23:36:11.975038 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.975004 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae"} err="failed to get container status \"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae\": rpc error: code = NotFound desc = could not find container \"7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae\": container with ID starting with 7642ac4dbb7366e33d23d9460edd8e45dec5f41208dae40f30924588a59e64ae not found: ID does not exist" Jul 02 23:36:11.983425 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.983404 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:36:11.987854 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:11.987832 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-782a03-openshift-default-7bdd96c9-bvcs8"] Jul 02 23:36:12.926793 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:12.926752 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" path="/var/lib/kubelet/pods/66922c48-dfb6-4af3-af44-623fb6fff1b1/volumes" Jul 02 23:36:14.987049 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.987013 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:36:14.987630 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.987583 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:36:14.987630 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.987598 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:36:14.987806 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.987729 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:36:14.987806 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.987743 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:36:14.992780 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.992754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:14.995457 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:14.995425 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-83f2de-openshift-default-dockercfg-lb4tt\"" Jul 02 23:36:15.002585 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.002561 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:36:15.084404 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084520 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vlq\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084520 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084599 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084599 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084695 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.084815 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.084734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185498 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vlq\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185657 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185657 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185763 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185763 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185865 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185917 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.185984 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.185932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186070 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186070 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186182 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186101 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186339 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186420 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.186485 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.186472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.188088 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.188065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.188191 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.188159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.192960 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.192938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.193198 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.193178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vlq\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq\") pod \"e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.306442 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.306423 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:15.446900 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.446873 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:36:15.448803 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:36:15.448772 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode317b02a_efd1_4e0f_b486_2b5f3409e388.slice/crio-8b9623efa85122d85a7c182e8f69850e8fd0c1baaf5e1cd9b494cfd90cd98dad WatchSource:0}: Error finding container 8b9623efa85122d85a7c182e8f69850e8fd0c1baaf5e1cd9b494cfd90cd98dad: Status 404 returned error can't find the container with id 8b9623efa85122d85a7c182e8f69850e8fd0c1baaf5e1cd9b494cfd90cd98dad Jul 02 23:36:15.450972 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.450933 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:15.451059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.450999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:15.451059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.451028 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:15.978280 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.978249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerStarted","Data":"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af"} Jul 02 23:36:15.978455 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.978300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerStarted","Data":"8b9623efa85122d85a7c182e8f69850e8fd0c1baaf5e1cd9b494cfd90cd98dad"} Jul 02 23:36:15.996806 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:15.996756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podStartSLOduration=1.996740951 podStartE2EDuration="1.996740951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:36:15.995243933 +0000 UTC m=+2097.742543042" watchObservedRunningTime="2026-07-02 23:36:15.996740951 +0000 UTC m=+2097.744040053" Jul 02 23:36:16.307367 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:16.307338 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:16.311635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:16.311616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:16.986047 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:16.986006 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:16.994206 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:16.994164 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:18.861900 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:18.861865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:36:18.865570 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:18.865540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:36:18.866539 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:18.866521 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:36:18.869923 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:18.869907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:36:23.943278 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:23.943209 2564 patch_prober.go:28] interesting pod/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 23:36:23.943278 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:23.943256 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 23:36:24.035263 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.035234 2564 generic.go:356] "Generic (PLEG): container finished" podID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerID="45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140" exitCode=0 Jul 02 23:36:24.035416 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.035314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerDied","Data":"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140"} Jul 02 23:36:24.035707 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.035694 2564 scope.go:117] "RemoveContainer" containerID="45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140" Jul 02 23:36:24.036709 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.036653 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:24.036801 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.036738 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:24.036801 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:24.036770 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:25.044803 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:25.044765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerStarted","Data":"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10"} Jul 02 23:36:25.440810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:25.440780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:25.441013 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:25.440988 2564 patch_prober.go:28] interesting pod/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 23:36:25.441078 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:25.441040 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 23:36:26.441158 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:26.441118 2564 patch_prober.go:28] interesting pod/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 23:36:26.441539 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:26.441192 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 23:36:27.440690 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:27.440644 2564 patch_prober.go:28] interesting pod/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 23:36:27.440884 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:27.440729 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 23:36:28.440754 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:28.440720 2564 patch_prober.go:28] interesting pod/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 23:36:28.441200 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:28.440780 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 23:36:29.067008 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.066977 2564 generic.go:356] "Generic (PLEG): container finished" podID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerID="1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af" exitCode=0 Jul 02 23:36:29.067239 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.067054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerDied","Data":"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af"} Jul 02 23:36:29.067524 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.067505 2564 scope.go:117] "RemoveContainer" containerID="1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af" Jul 02 23:36:29.068572 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.068542 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:29.068625 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.068614 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:29.068660 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.068648 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 23:36:29.444190 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.444104 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:29.444561 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.444330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:29.444911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:29.444896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:36:30.074930 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:30.074874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerStarted","Data":"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73"} Jul 02 23:36:30.306746 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:30.306700 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:30.307831 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:30.307805 2564 patch_prober.go:28] interesting pod/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 23:36:30.307942 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:30.307869 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 23:36:31.307723 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:31.307691 2564 patch_prober.go:28] interesting pod/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 23:36:31.308080 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:31.307739 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 23:36:31.986680 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:31.986635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:32.306762 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:32.306726 2564 patch_prober.go:28] interesting pod/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 23:36:32.306926 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:32.306786 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 23:36:33.307625 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:33.307585 2564 patch_prober.go:28] interesting pod/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 23:36:33.308036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:33.307656 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 23:36:34.310775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:34.310748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:36:34.311715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:36:34.311697 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:41:18.891480 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:41:18.891450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:41:18.896231 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:41:18.896210 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:41:18.913600 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:41:18.913578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:41:18.917643 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:41:18.917626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ftr95_29418216-89f4-4344-9e92-14273638d7c4/ovn-acl-logging/0.log" Jul 02 23:42:38.492345 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:38.492300 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:42:38.492915 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:38.492513 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" containerID="cri-o://fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10" gracePeriod=30 Jul 02 23:42:43.748107 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.748083 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:42:43.845079 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845052 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845087 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845104 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845136 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845160 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845202 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845238 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845226 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845269 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845343 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7fj8\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8\") pod \"c25c26a3-2625-4aec-a2c5-c572632f4607\" (UID: \"c25c26a3-2625-4aec-a2c5-c572632f4607\") " Jul 02 23:42:43.845550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845362 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:43.845550 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845507 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:43.845774 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845586 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:43.845825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845794 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.845825 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845819 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.845906 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.845835 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.846252 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.846218 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data" (OuterVolumeSpecName: "istio-data") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:43.846611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.846584 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:42:43.847427 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.847405 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token" (OuterVolumeSpecName: "istio-token") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:43.847511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.847476 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8" (OuterVolumeSpecName: "kube-api-access-g7fj8") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "kube-api-access-g7fj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:43.847511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.847469 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:42:43.847511 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.847497 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c25c26a3-2625-4aec-a2c5-c572632f4607" (UID: "c25c26a3-2625-4aec-a2c5-c572632f4607"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:43.947042 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947018 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7fj8\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-kube-api-access-g7fj8\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.947042 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947040 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.947164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947049 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.947164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947057 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.947164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947064 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c25c26a3-2625-4aec-a2c5-c572632f4607-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.947164 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.947071 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c25c26a3-2625-4aec-a2c5-c572632f4607-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:43.969898 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.969864 2564 generic.go:356] "Generic (PLEG): container finished" podID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerID="fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10" exitCode=0 Jul 02 23:42:43.970001 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.969905 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" Jul 02 23:42:43.970001 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.969897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerDied","Data":"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10"} Jul 02 23:42:43.970086 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.970042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8" event={"ID":"c25c26a3-2625-4aec-a2c5-c572632f4607","Type":"ContainerDied","Data":"8db9f7f448a8fd7d407f37a652123f26e5a4011e7e38d63adde1c135de1cd5c2"} Jul 02 23:42:43.970086 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.970070 2564 scope.go:117] "RemoveContainer" containerID="fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10" Jul 02 23:42:43.979393 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.979378 2564 scope.go:117] "RemoveContainer" containerID="45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140" Jul 02 23:42:43.986970 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.986954 2564 scope.go:117] "RemoveContainer" containerID="fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10" Jul 02 23:42:43.987213 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:42:43.987194 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10\": container with ID starting with fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10 not found: ID does not exist" containerID="fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10" Jul 02 23:42:43.987276 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.987223 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10"} err="failed to get container status \"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10\": rpc error: code = NotFound desc = could not find container \"fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10\": container with ID starting with fb29505e2c34ed8ff0ff1b03550a9ea97163cfbfffa4a17e9f3dc208bb81ae10 not found: ID does not exist" Jul 02 23:42:43.987276 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.987240 2564 scope.go:117] "RemoveContainer" containerID="45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140" Jul 02 23:42:43.987474 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:42:43.987458 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140\": container with ID starting with 45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140 not found: ID does not exist" containerID="45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140" Jul 02 23:42:43.987522 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.987479 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140"} err="failed to get container status \"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140\": rpc error: code = NotFound desc = could not find container \"45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140\": container with ID starting with 45e4937284d8fd4cb69a5b9693916de696d2ff600a254c47e0ff812e54a09140 not found: ID does not exist" Jul 02 23:42:43.993186 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.993164 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:42:43.996866 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:43.996845 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9352c3-openshift-default-5465c56679-6vlm8"] Jul 02 23:42:44.926073 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:44.926035 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" path="/var/lib/kubelet/pods/c25c26a3-2625-4aec-a2c5-c572632f4607/volumes" Jul 02 23:42:45.490405 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:45.490372 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:42:45.490813 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:45.490645 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" containerID="cri-o://6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73" gracePeriod=30 Jul 02 23:42:49.313523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:49.313487 2564 patch_prober.go:28] interesting pod/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 23:42:49.313911 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:49.313555 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:42:50.739383 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.739360 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:42:50.801033 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801009 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801142 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801059 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801142 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801096 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801142 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801120 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801161 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7vlq\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801189 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801228 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801239 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:50.801319 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801299 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy\") pod \"e317b02a-efd1-4e0f-b486-2b5f3409e388\" (UID: \"e317b02a-efd1-4e0f-b486-2b5f3409e388\") " Jul 02 23:42:50.801601 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801413 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:50.801658 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801611 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:50.801658 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801648 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:42:50.801797 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801734 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.801797 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801754 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-workload-certs\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.801797 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.801766 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-credential-socket\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.802036 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.802017 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data" (OuterVolumeSpecName: "istio-data") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:50.803344 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.803320 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:42:50.803449 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.803368 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token" (OuterVolumeSpecName: "istio-token") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:50.803775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.803753 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:50.803775 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.803765 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq" (OuterVolumeSpecName: "kube-api-access-d7vlq") pod "e317b02a-efd1-4e0f-b486-2b5f3409e388" (UID: "e317b02a-efd1-4e0f-b486-2b5f3409e388"). InnerVolumeSpecName "kube-api-access-d7vlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:50.902715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902692 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-data\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.902715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902713 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-podinfo\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.902835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902721 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-envoy\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.902835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902729 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-istio-token\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.902835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902736 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e317b02a-efd1-4e0f-b486-2b5f3409e388-istiod-ca-cert\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.902835 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.902743 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7vlq\" (UniqueName: \"kubernetes.io/projected/e317b02a-efd1-4e0f-b486-2b5f3409e388-kube-api-access-d7vlq\") on node \"ip-10-0-132-1.ec2.internal\" DevicePath \"\"" Jul 02 23:42:50.995123 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:50.995106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717235-645lb_9c3941d6-6c42-48c7-8c0d-650b6ac8d933/cleanup/0.log" Jul 02 23:42:51.003265 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.003239 2564 generic.go:356] "Generic (PLEG): container finished" podID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerID="6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73" exitCode=0 Jul 02 23:42:51.003356 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.003291 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" Jul 02 23:42:51.003356 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.003325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerDied","Data":"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73"} Jul 02 23:42:51.003537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.003375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g" event={"ID":"e317b02a-efd1-4e0f-b486-2b5f3409e388","Type":"ContainerDied","Data":"8b9623efa85122d85a7c182e8f69850e8fd0c1baaf5e1cd9b494cfd90cd98dad"} Jul 02 23:42:51.003537 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.003399 2564 scope.go:117] "RemoveContainer" containerID="6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73" Jul 02 23:42:51.011593 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.011577 2564 scope.go:117] "RemoveContainer" containerID="1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af" Jul 02 23:42:51.018810 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.018786 2564 scope.go:117] "RemoveContainer" containerID="6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73" Jul 02 23:42:51.019054 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:42:51.019037 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73\": container with ID starting with 6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73 not found: ID does not exist" containerID="6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73" Jul 02 23:42:51.019127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.019064 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73"} err="failed to get container status \"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73\": rpc error: code = NotFound desc = could not find container \"6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73\": container with ID starting with 6c37268cbee1d4001926265244152f0d5c33a77350000ed00363b725b4426f73 not found: ID does not exist" Jul 02 23:42:51.019127 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.019085 2564 scope.go:117] "RemoveContainer" containerID="1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af" Jul 02 23:42:51.019317 ip-10-0-132-1 kubenswrapper[2564]: E0702 23:42:51.019302 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af\": container with ID starting with 1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af not found: ID does not exist" containerID="1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af" Jul 02 23:42:51.019366 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.019323 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af"} err="failed to get container status \"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af\": rpc error: code = NotFound desc = could not find container \"1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af\": container with ID starting with 1c68ad55da20fb0d943027634f09caaf512303ec0a89c5efe7c5c00395ed18af not found: ID does not exist" Jul 02 23:42:51.022604 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.022582 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:42:51.027156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.027135 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-83f2de-openshift-default-7654c6f999-dfp9g"] Jul 02 23:42:51.105069 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.105012 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-vw7n4_ba6e3061-9643-4cdf-a113-5e172f388bd4/cleanup/0.log" Jul 02 23:42:51.216293 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.216275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-679fc747b4-r6gzg_e9168e0e-5b2b-4511-ba21-b226b4a786e3/manager/0.log" Jul 02 23:42:51.667059 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.667033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-jw8rg_1078571f-5497-4cb6-839f-8261aa73bb54/copy-manifests/0.log" Jul 02 23:42:51.679791 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:51.679768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-jw8rg_1078571f-5497-4cb6-839f-8261aa73bb54/manager/0.log" Jul 02 23:42:52.934495 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:52.934456 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" path="/var/lib/kubelet/pods/e317b02a-efd1-4e0f-b486-2b5f3409e388/volumes" Jul 02 23:42:54.285946 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:54.285914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bkjxb_d9238523-af7a-4885-be89-37b00f3f842f/istio-proxy/0.log" Jul 02 23:42:54.398878 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:54.398853 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d88v7_6edf7f9e-6649-4f95-80ba-464fd6d1abf1/discovery/0.log" Jul 02 23:42:54.734532 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:54.734463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/1.log" Jul 02 23:42:54.847562 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:54.847538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g78dn_0c22c25a-0235-4e86-8a3c-d2f72c7c8112/payload-pre-processing/0.log" Jul 02 23:42:55.074421 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:55.074399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfdbf6f99-zd6tw_55937711-f982-430e-bd43-e29b9d2a4aa0/router/0.log" Jul 02 23:42:55.516379 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:55.516296 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2n6vc_caff459f-f75b-4d21-93cc-d8b9d732e47b/main/0.log" Jul 02 23:42:55.624009 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:55.623979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zkk8v_daae85c0-4fa7-461e-862f-8355c7dc0496/main/0.log" Jul 02 23:42:55.727889 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:42:55.727869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbq6k2_192f2b80-8a5f-46a9-9e34-463210cb5ed7/main/0.log" Jul 02 23:43:03.096191 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:03.096161 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdskt_54e56f1c-74c8-4f3e-b9fe-d0cd04ed28d3/global-pull-secret-syncer/0.log" Jul 02 23:43:03.220293 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:03.220267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mqhst_9507be0f-5079-4fa0-b6da-b049da8814ed/konnectivity-agent/0.log" Jul 02 23:43:03.267523 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:03.267506 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-1.ec2.internal_918217da534bcc19f9a258e306b2a309/haproxy/0.log" Jul 02 23:43:10.574061 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:10.574029 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-x4866_4ca19cbb-e239-4e78-9852-5a444f05d52e/cluster-monitoring-operator/0.log" Jul 02 23:43:10.693901 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:10.693878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-ttpnx_a29dfc19-041d-4d00-9b34-8abd774c343a/monitoring-plugin/0.log" Jul 02 23:43:10.869635 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:10.869602 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxw6k_4b1ff81e-5faf-41ce-8d11-d236c4121130/node-exporter/0.log" Jul 02 23:43:10.888274 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:10.888256 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxw6k_4b1ff81e-5faf-41ce-8d11-d236c4121130/kube-rbac-proxy/0.log" Jul 02 23:43:10.906805 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:10.906788 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxw6k_4b1ff81e-5faf-41ce-8d11-d236c4121130/init-textfile/0.log" Jul 02 23:43:11.012573 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.012550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/prometheus/0.log" Jul 02 23:43:11.038030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.032264 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/config-reloader/0.log" Jul 02 23:43:11.050367 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.050348 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/thanos-sidecar/0.log" Jul 02 23:43:11.068747 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.068731 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/kube-rbac-proxy-web/0.log" Jul 02 23:43:11.088030 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.087944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/kube-rbac-proxy/0.log" Jul 02 23:43:11.108519 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.108500 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/kube-rbac-proxy-thanos/0.log" Jul 02 23:43:11.130271 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.130257 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3718cf27-9afa-492f-a52d-53759ab749b2/init-config-reloader/0.log" Jul 02 23:43:11.167155 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.167140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-ks5zf_b8fdc96c-7517-4304-8835-937e726bb705/prometheus-operator/0.log" Jul 02 23:43:11.184871 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.184855 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-ks5zf_b8fdc96c-7517-4304-8835-937e726bb705/kube-rbac-proxy/0.log" Jul 02 23:43:11.207027 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:11.207007 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-kwj45_3e7fad82-153f-4cab-b4e0-808df74b4730/prometheus-operator-admission-webhook/0.log" Jul 02 23:43:12.526431 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:12.526397 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-hm7g7_fa7013a9-ec4d-48eb-b682-943af2af102b/networking-console-plugin/0.log" Jul 02 23:43:13.125715 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.125653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/2.log" Jul 02 23:43:13.131628 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.131594 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr"] Jul 02 23:43:13.132167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132138 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.132167 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132158 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132170 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132179 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="66922c48-dfb6-4af3-af44-623fb6fff1b1" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132203 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132214 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132252 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132261 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132273 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132298 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132281 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132586 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132365 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132586 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132378 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c25c26a3-2625-4aec-a2c5-c572632f4607" containerName="istio-proxy" Jul 02 23:43:13.132586 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132392 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.132586 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.132399 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e317b02a-efd1-4e0f-b486-2b5f3409e388" containerName="istio-proxy" Jul 02 23:43:13.134611 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.134589 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gf48_76d2e0f3-4208-4c1c-9bd4-486aed561e8b/console-operator/3.log" Jul 02 23:43:13.135829 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.135811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.138690 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.138655 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dblpz\"/\"kube-root-ca.crt\"" Jul 02 23:43:13.138822 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.138752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dblpz\"/\"openshift-service-ca.crt\"" Jul 02 23:43:13.139883 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.139846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dblpz\"/\"default-dockercfg-27qc6\"" Jul 02 23:43:13.144836 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.144809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr"] Jul 02 23:43:13.282491 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.282470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-lib-modules\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.282610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.282497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-sys\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.282610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.282522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-proc\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.282610 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.282567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pskbl\" (UniqueName: \"kubernetes.io/projected/d16c1c86-5109-4b86-a0c2-40a074ea0c32-kube-api-access-pskbl\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.282779 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.282626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-podres\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383071 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-lib-modules\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383071 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-sys\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383071 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-proc\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-proc\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-sys\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pskbl\" (UniqueName: \"kubernetes.io/projected/d16c1c86-5109-4b86-a0c2-40a074ea0c32-kube-api-access-pskbl\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-podres\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383249 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383187 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-lib-modules\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.383431 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.383263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d16c1c86-5109-4b86-a0c2-40a074ea0c32-podres\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.391365 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.391337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pskbl\" (UniqueName: \"kubernetes.io/projected/d16c1c86-5109-4b86-a0c2-40a074ea0c32-kube-api-access-pskbl\") pod \"perf-node-gather-daemonset-2s5pr\" (UID: \"d16c1c86-5109-4b86-a0c2-40a074ea0c32\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.448224 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.448204 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:13.576426 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:13.576403 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr"] Jul 02 23:43:13.578160 ip-10-0-132-1 kubenswrapper[2564]: W0702 23:43:13.578131 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd16c1c86_5109_4b86_a0c2_40a074ea0c32.slice/crio-3198f9ef4ae703d8644d4437421a37cf0f5e21983b7fe8948aadc0d969d56410 WatchSource:0}: Error finding container 3198f9ef4ae703d8644d4437421a37cf0f5e21983b7fe8948aadc0d969d56410: Status 404 returned error can't find the container with id 3198f9ef4ae703d8644d4437421a37cf0f5e21983b7fe8948aadc0d969d56410 Jul 02 23:43:14.109987 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:14.109952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" event={"ID":"d16c1c86-5109-4b86-a0c2-40a074ea0c32","Type":"ContainerStarted","Data":"88b3b7a91c1ebac0a77f6a7de754d009328a2bd3c7a575e7d169b1c139c672e6"} Jul 02 23:43:14.110135 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:14.110001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" event={"ID":"d16c1c86-5109-4b86-a0c2-40a074ea0c32","Type":"ContainerStarted","Data":"3198f9ef4ae703d8644d4437421a37cf0f5e21983b7fe8948aadc0d969d56410"} Jul 02 23:43:14.110135 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:14.110031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:14.127283 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:14.127237 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" podStartSLOduration=1.127223942 podStartE2EDuration="1.127223942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:14.124983614 +0000 UTC m=+2515.872282723" watchObservedRunningTime="2026-07-02 23:43:14.127223942 +0000 UTC m=+2515.874523089" Jul 02 23:43:14.312024 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:14.311991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-lh8fh_bc9e8eb3-9df9-4eb2-a076-47d06dcab7bc/volume-data-source-validator/0.log" Jul 02 23:43:15.360587 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:15.360555 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xcdz8_3b17f246-957b-40b6-a2e3-8fed08fa8810/dns/0.log" Jul 02 23:43:15.379042 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:15.379020 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xcdz8_3b17f246-957b-40b6-a2e3-8fed08fa8810/kube-rbac-proxy/0.log" Jul 02 23:43:15.444623 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:15.444602 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcnrf_b5a3d848-0a79-4a9a-b62c-98a124b5d0be/dns-node-resolver/0.log" Jul 02 23:43:16.007316 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:16.007291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jx26x_33411e0d-67c4-4133-b062-c6f8d19653fd/node-ca/0.log" Jul 02 23:43:16.922540 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:16.922502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bkjxb_d9238523-af7a-4885-be89-37b00f3f842f/istio-proxy/0.log" Jul 02 23:43:17.029007 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.028974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d88v7_6edf7f9e-6649-4f95-80ba-464fd6d1abf1/discovery/0.log" Jul 02 23:43:17.097116 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.097080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/0.log" Jul 02 23:43:17.120137 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.120113 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/1.log" Jul 02 23:43:17.170362 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.170337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g78dn_0c22c25a-0235-4e86-8a3c-d2f72c7c8112/payload-pre-processing/0.log" Jul 02 23:43:17.234435 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.234375 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfdbf6f99-zd6tw_55937711-f982-430e-bd43-e29b9d2a4aa0/router/0.log" Jul 02 23:43:17.881890 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:17.881854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jdh7g_b09ddb01-9003-4d81-a884-36bcc54d65ea/serve-healthcheck-canary/0.log" Jul 02 23:43:18.357123 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:18.357096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c885l_6f482f90-60e7-4c70-806a-7adcd2ba4a9c/insights-operator/0.log" Jul 02 23:43:18.358628 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:18.358609 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c885l_6f482f90-60e7-4c70-806a-7adcd2ba4a9c/insights-operator/1.log" Jul 02 23:43:18.378274 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:18.378234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpqxg_e818487d-611e-430d-8166-f3328149b88b/kube-rbac-proxy/0.log" Jul 02 23:43:18.396963 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:18.396942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpqxg_e818487d-611e-430d-8166-f3328149b88b/exporter/0.log" Jul 02 23:43:18.419267 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:18.419245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpqxg_e818487d-611e-430d-8166-f3328149b88b/extractor/0.log" Jul 02 23:43:20.125471 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:20.125437 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-2s5pr" Jul 02 23:43:20.719406 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:20.719380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717235-645lb_9c3941d6-6c42-48c7-8c0d-650b6ac8d933/cleanup/0.log" Jul 02 23:43:20.740900 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:20.740868 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-vw7n4_ba6e3061-9643-4cdf-a113-5e172f388bd4/cleanup/0.log" Jul 02 23:43:20.836341 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:20.836318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-679fc747b4-r6gzg_e9168e0e-5b2b-4511-ba21-b226b4a786e3/manager/0.log" Jul 02 23:43:21.044333 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:21.044311 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-jw8rg_1078571f-5497-4cb6-839f-8261aa73bb54/manager/0.log" Jul 02 23:43:21.059781 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:21.059764 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-jw8rg_1078571f-5497-4cb6-839f-8261aa73bb54/copy-manifests/0.log" Jul 02 23:43:22.538128 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:22.538106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f69f5c6b6-7b4fd_ca363977-0346-4b31-8919-8876e73e3b81/manager/0.log" Jul 02 23:43:23.479800 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.479779 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bkjxb_d9238523-af7a-4885-be89-37b00f3f842f/istio-proxy/0.log" Jul 02 23:43:23.578368 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.578341 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d88v7_6edf7f9e-6649-4f95-80ba-464fd6d1abf1/discovery/0.log" Jul 02 23:43:23.629703 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.629681 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/0.log" Jul 02 23:43:23.654842 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.654811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/1.log" Jul 02 23:43:23.673147 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.673126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g78dn_0c22c25a-0235-4e86-8a3c-d2f72c7c8112/payload-pre-processing/0.log" Jul 02 23:43:23.722011 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:23.721993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfdbf6f99-zd6tw_55937711-f982-430e-bd43-e29b9d2a4aa0/router/0.log" Jul 02 23:43:24.918931 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:24.918830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bkjxb_d9238523-af7a-4885-be89-37b00f3f842f/istio-proxy/0.log" Jul 02 23:43:25.015125 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:25.015100 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d88v7_6edf7f9e-6649-4f95-80ba-464fd6d1abf1/discovery/0.log" Jul 02 23:43:25.063156 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:25.063126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/0.log" Jul 02 23:43:25.089271 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:25.089251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kdvkf_a5cafcae-f664-482e-801a-545e0435398e/istio-proxy/1.log" Jul 02 23:43:25.107639 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:25.107619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g78dn_0c22c25a-0235-4e86-8a3c-d2f72c7c8112/payload-pre-processing/0.log" Jul 02 23:43:25.162534 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:25.162503 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dfdbf6f99-zd6tw_55937711-f982-430e-bd43-e29b9d2a4aa0/router/0.log" Jul 02 23:43:27.898646 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:27.898617 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bqksh_ebfae3ee-c102-4056-8b81-34df5621fe50/kube-storage-version-migrator-operator/1.log" Jul 02 23:43:27.899480 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:27.899463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bqksh_ebfae3ee-c102-4056-8b81-34df5621fe50/kube-storage-version-migrator-operator/0.log" Jul 02 23:43:28.789895 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.789871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/kube-multus-additional-cni-plugins/0.log" Jul 02 23:43:28.808961 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.808936 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/egress-router-binary-copy/0.log" Jul 02 23:43:28.825815 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.825797 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/cni-plugins/0.log" Jul 02 23:43:28.844254 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.844238 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/bond-cni-plugin/0.log" Jul 02 23:43:28.862434 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.862412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/routeoverride-cni/0.log" Jul 02 23:43:28.880965 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.880946 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/whereabouts-cni-bincopy/0.log" Jul 02 23:43:28.898701 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:28.898684 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjp5x_f5645fcf-cc4a-48a1-8ff6-707af076eab3/whereabouts-cni/0.log" Jul 02 23:43:29.211731 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:29.211706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fqnnc_6649b25d-16d3-48a6-88b1-540638b589de/kube-multus/0.log" Jul 02 23:43:29.284222 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:29.284197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6gphg_523f04e9-208a-445f-b131-4daf5c7fe32e/network-metrics-daemon/0.log" Jul 02 23:43:29.301092 ip-10-0-132-1 kubenswrapper[2564]: I0702 23:43:29.301072 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6gphg_523f04e9-208a-445f-b131-4daf5c7fe32e/kube-rbac-proxy/0.log"