Jul 05 19:28:15.288878 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 19:28:15.288891 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 19:28:15.288901 ip-10-0-142-62 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 19:28:15.289217 ip-10-0-142-62 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 19:28:25.538266 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 19:28:25.538283 ip-10-0-142-62 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9da6fc4f28714519902f74e0304f576b -- Jul 05 19:30:01.260419 ip-10-0-142-62 systemd[1]: Starting Kubernetes Kubelet... Jul 05 19:30:01.687838 ip-10-0-142-62 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:30:01.687838 ip-10-0-142-62 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 19:30:01.687838 ip-10-0-142-62 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:30:01.687838 ip-10-0-142-62 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 19:30:01.687838 ip-10-0-142-62 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 19:30:01.690692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.690612 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 19:30:01.695642 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695626 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.695642 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695643 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695646 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695650 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695652 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695655 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695657 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695660 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695662 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695665 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695668 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695670 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695673 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695675 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695678 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695680 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695683 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695688 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695698 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695701 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.695703 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695704 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695707 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695710 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695712 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695715 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695718 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695721 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695723 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695726 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695728 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695731 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695733 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695736 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695738 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695741 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695743 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695746 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695748 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695751 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695753 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.696299 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695755 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695758 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695760 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695762 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695765 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695767 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695769 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695772 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695775 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695779 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695782 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695785 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695788 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695791 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695794 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695797 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695799 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695802 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695805 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695807 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.696786 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695809 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695812 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695815 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695818 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695820 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695823 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695825 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695827 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695830 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695832 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695835 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695839 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695842 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695845 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695847 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695850 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695852 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695856 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695858 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.697298 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695861 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695863 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695866 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695869 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695871 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695875 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695878 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695881 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695884 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695886 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695889 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695892 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695894 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695897 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695900 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695903 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695905 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695907 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695910 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.695913 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.697775 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696615 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696622 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696624 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696627 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696630 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696632 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696635 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696638 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696643 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696645 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696648 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696650 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696652 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696655 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696658 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696660 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696663 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696666 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.698276 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696669 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696674 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696678 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696681 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696683 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696686 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696689 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696691 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696694 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696696 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696699 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696701 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696704 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696706 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696709 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696711 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696714 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696717 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696720 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696722 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.698746 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696725 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696727 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696730 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696733 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696735 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696738 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696740 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696742 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696747 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696750 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696753 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696756 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696760 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696764 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696767 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696770 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696773 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696776 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696778 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.699252 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696781 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696783 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696786 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696789 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696791 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696794 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696797 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696799 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696802 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696804 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696807 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696811 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696814 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696816 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696819 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696821 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696824 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696826 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696829 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696831 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.699747 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696834 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696836 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696839 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696842 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696845 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696849 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696852 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696855 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696857 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696860 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696862 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696865 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696867 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696869 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696872 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696874 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696877 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696879 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696882 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696884 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.700251 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.696886 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697256 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697261 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697264 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697266 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697269 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697271 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697274 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697277 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697279 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697282 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697284 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697287 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697289 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697292 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697294 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697297 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697300 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697311 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697314 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.700727 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697317 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697320 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697322 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697325 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697328 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697330 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697333 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697335 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697338 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697340 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697343 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697345 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697348 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697350 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697352 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697355 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697357 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697360 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697362 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697365 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.701270 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697368 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697370 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697373 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697376 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697378 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697381 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697384 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697386 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697389 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697392 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697394 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697397 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697400 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697402 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697404 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697407 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697409 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697412 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697414 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697418 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.701753 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697420 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697423 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697425 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697428 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697430 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697433 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697435 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697438 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697441 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697445 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697448 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697450 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697453 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697455 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697458 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697460 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697463 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697465 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697468 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697471 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.702249 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697474 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697476 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697479 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697483 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697487 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697491 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697495 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697497 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697500 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697503 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697505 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697508 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697511 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697513 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697516 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697518 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697521 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697523 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697526 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.702781 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.697528 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697608 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697624 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697633 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697640 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697645 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697648 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697654 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697658 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697670 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697674 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697677 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697684 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697687 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697689 2576 flags.go:64] FLAG: --cgroup-root="" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697692 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697695 2576 flags.go:64] FLAG: --client-ca-file="" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697698 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697702 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697705 2576 flags.go:64] FLAG: --cluster-domain="" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697708 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697711 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697714 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697717 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 19:30:01.703271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697721 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697724 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697727 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697730 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697733 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697736 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697739 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697742 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697744 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697748 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697751 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697754 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697756 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697760 2576 flags.go:64] FLAG: --enable-server="true" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697762 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697767 2576 flags.go:64] FLAG: --event-burst="100" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697770 2576 flags.go:64] FLAG: --event-qps="50" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697773 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697776 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697779 2576 flags.go:64] FLAG: --eviction-hard="" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697784 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697787 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697789 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697792 2576 flags.go:64] FLAG: --eviction-soft="" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697795 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 19:30:01.703846 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697798 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697801 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697804 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697807 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697810 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697812 2576 flags.go:64] FLAG: --feature-gates="" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697816 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697819 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697822 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697825 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697828 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697831 2576 flags.go:64] FLAG: --help="false" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697833 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-62.ec2.internal" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697836 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697839 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697842 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697845 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697848 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697851 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697853 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697856 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697858 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697862 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697865 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 19:30:01.704484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697868 2576 flags.go:64] FLAG: --kube-reserved="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697870 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697873 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697877 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697880 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697882 2576 flags.go:64] FLAG: --lock-file="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697885 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697888 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697890 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697896 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697899 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697902 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697905 2576 flags.go:64] FLAG: --logging-format="text" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697908 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697911 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697914 2576 flags.go:64] FLAG: --manifest-url="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697917 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697921 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697924 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697928 2576 flags.go:64] FLAG: --max-pods="110" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697930 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697933 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697936 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697939 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697942 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 19:30:01.705084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697944 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697947 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697954 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697957 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697960 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697965 2576 flags.go:64] FLAG: --pod-cidr="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697967 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697973 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697976 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697979 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697982 2576 flags.go:64] FLAG: --port="10250" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697986 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697989 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00a5daf633af400f8" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697991 2576 flags.go:64] FLAG: --qos-reserved="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697994 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.697997 2576 flags.go:64] FLAG: --register-node="true" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698000 2576 flags.go:64] FLAG: --register-with-taints="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698003 2576 flags.go:64] FLAG: --registry-burst="10" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698006 2576 flags.go:64] FLAG: --registry-qps="5" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698009 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698012 2576 flags.go:64] FLAG: --reserved-memory="" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698015 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698018 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698021 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698024 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 19:30:01.705734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698026 2576 flags.go:64] FLAG: --runonce="false" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698029 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698032 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698034 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698037 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698040 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698042 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698045 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698048 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698051 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698053 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698056 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698060 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698063 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698066 2576 flags.go:64] FLAG: --system-cgroups="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698069 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698073 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698076 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698080 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698083 2576 flags.go:64] FLAG: --tls-min-version="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698086 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698089 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698091 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698094 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698097 2576 flags.go:64] FLAG: --v="2" Jul 05 19:30:01.706399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698101 2576 flags.go:64] FLAG: --version="false" Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698105 2576 flags.go:64] FLAG: --vmodule="" Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698109 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.698112 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698246 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698253 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698256 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698259 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698262 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698264 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698267 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698269 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698273 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698277 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698280 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698282 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698285 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698288 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698293 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.707015 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698295 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698298 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698300 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698303 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698306 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698309 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698311 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698313 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698316 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698318 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698321 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698323 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698326 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698328 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698331 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698334 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698336 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698339 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698341 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698344 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.707527 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698346 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698348 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698350 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698353 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698355 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698358 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698360 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698362 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698365 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698367 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698369 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698373 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698375 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698378 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698380 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698382 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698386 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698390 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698392 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.708357 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698395 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698397 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698400 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698402 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698404 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698407 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698410 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698412 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698414 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698417 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698420 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698422 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698425 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698427 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698429 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698431 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698434 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698436 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698439 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.708996 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698441 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698443 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698446 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698448 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698452 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698456 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698459 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698462 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698465 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698467 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698469 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698472 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698474 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698477 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698479 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698481 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698484 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698486 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698489 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.709499 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698491 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698494 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698496 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698498 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698501 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.698503 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.699229 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.709519 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.709536 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.709556 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.709565 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709623 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709628 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709631 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709634 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.709972 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709637 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709640 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709642 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709645 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709648 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709650 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709653 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709655 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709658 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709707 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709711 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709714 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709717 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709720 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709723 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709725 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709727 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709731 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709733 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709735 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.710372 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709738 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709740 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709743 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709745 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709748 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709751 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709754 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709757 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709760 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709762 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709766 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709770 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709774 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709777 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709780 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709783 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709785 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709788 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709790 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.710870 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709793 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709795 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709798 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709801 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709803 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709806 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709808 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709811 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709813 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709815 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709818 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709820 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709823 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709825 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709828 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709832 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709836 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709838 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709842 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709844 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.711356 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709847 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709850 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709853 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709855 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709858 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709860 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709863 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709865 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709868 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709870 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709872 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709875 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709877 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709879 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709882 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709884 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709887 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709890 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709892 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709895 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.711847 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709897 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709899 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709902 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709904 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709907 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709909 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709911 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709914 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709916 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709919 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709922 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709926 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709928 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709930 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709933 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.712348 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.709935 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.709941 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710053 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710059 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710062 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710065 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710068 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710070 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710073 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710076 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710078 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710081 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710084 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710086 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710090 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 19:30:01.712719 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710092 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710095 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710098 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710100 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710103 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710105 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710107 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710110 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710112 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710115 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710117 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710120 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710124 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710127 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710130 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710133 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710135 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710138 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710140 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710160 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 19:30:01.713125 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710164 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710166 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710169 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710172 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710175 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710177 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710180 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710182 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710185 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710187 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710190 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710192 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710196 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710198 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710201 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710203 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710206 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710208 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710210 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710213 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 19:30:01.713680 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710215 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710218 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710221 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710223 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710226 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710230 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710233 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710236 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710238 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710241 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710245 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710248 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710251 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710253 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710256 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710259 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710262 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710265 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710267 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 19:30:01.714302 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710270 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710272 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710274 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710277 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710279 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710282 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710285 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710287 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710289 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710292 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710294 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710296 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710299 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710301 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710304 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710306 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710309 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710311 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710314 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 19:30:01.714856 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710316 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710319 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710321 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710324 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710326 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710329 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710331 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:01.710334 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.710339 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.710448 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.712870 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.714558 2576 server.go:1019] "Starting client certificate rotation" Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.714671 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 19:30:01.715353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.714715 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 19:30:01.717390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.717372 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 19:30:01.718561 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.718541 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 19:30:01.728045 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.728029 2576 log.go:25] "Validated CRI v1 runtime API" Jul 05 19:30:01.730845 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.730826 2576 log.go:25] "Validated CRI v1 image API" Jul 05 19:30:01.734742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.734705 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 19:30:01.737411 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.737383 2576 fs.go:135] Filesystem UUIDs: map[51f68e23-5bbd-4e99-93a8-e1796a43dfc7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8628a990-24b4-444f-b650-6561ee1343f6:/dev/nvme0n1p3] Jul 05 19:30:01.737478 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.737412 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 19:30:01.743713 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.742423 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 19:30:01.745279 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.745170 2576 manager.go:216] Machine: {Timestamp:2026-07-05 19:30:01.742019149 +0000 UTC m=+0.369207591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085874 MemoryCapacity:32812187648 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21114593a4bb6c20027f8c6e36002d SystemUUID:ec211145-93a4-bb6c-2002-7f8c6e36002d BootID:9da6fc4f-2871-4519-902f-74e0304f576b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406093824 Type:vfs Inodes:4005394 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:44:34:ab:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:44:34:ab:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:64:5e:c0:57:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812187648 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 19:30:01.745279 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.745274 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 19:30:01.745396 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.745352 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 19:30:01.746640 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.746614 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 19:30:01.746770 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.746643 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 19:30:01.747615 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.747605 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 19:30:01.747652 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.747617 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 19:30:01.747652 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.747625 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 19:30:01.749170 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.749159 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 19:30:01.750951 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.750941 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 19:30:01.755474 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755462 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 05 19:30:01.755599 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755589 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 19:30:01.755633 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755619 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 05 19:30:01.755633 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755629 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 19:30:01.755684 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755640 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 19:30:01.755684 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755650 2576 kubelet.go:398] "Adding apiserver pod source" Jul 05 19:30:01.755684 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.755659 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 19:30:01.756101 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.756089 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 19:30:01.756168 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.756108 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 19:30:01.759403 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.759385 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 19:30:01.759484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.759432 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g85hz" Jul 05 19:30:01.761803 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.761786 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 19:30:01.761898 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.761825 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 19:30:01.762776 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.762751 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 19:30:01.762776 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.762751 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 19:30:01.763434 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763367 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 19:30:01.763491 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763453 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 19:30:01.763491 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763469 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 19:30:01.763491 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763478 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 19:30:01.763491 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763488 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763494 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763502 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763506 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763514 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763519 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763528 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763544 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763569 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 19:30:01.763601 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.763577 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 19:30:01.765167 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.765140 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g85hz" Jul 05 19:30:01.766255 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.766239 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 19:30:01.767362 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.767347 2576 server.go:1268] "Started kubelet" Jul 05 19:30:01.767459 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.767429 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 19:30:01.767659 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.767567 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 19:30:01.767722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.767694 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 19:30:01.768421 ip-10-0-142-62 systemd[1]: Started Kubernetes Kubelet. Jul 05 19:30:01.769233 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.769216 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 19:30:01.770674 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.770655 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 05 19:30:01.773306 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.773278 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 19:30:01.779208 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.779192 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 19:30:01.779965 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.779916 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 19:30:01.780101 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.780081 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:01.780731 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.780714 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 19:30:01.780731 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.780717 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 19:30:01.780858 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.780736 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 19:30:01.781050 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781037 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 05 19:30:01.781083 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781053 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 05 19:30:01.781215 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781201 2576 factory.go:55] Registering systemd factory Jul 05 19:30:01.781247 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781222 2576 factory.go:223] Registration of the systemd container factory successfully Jul 05 19:30:01.781442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781428 2576 factory.go:153] Registering CRI-O factory Jul 05 19:30:01.781488 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781447 2576 factory.go:223] Registration of the crio container factory successfully Jul 05 19:30:01.781517 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781499 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 19:30:01.781546 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781521 2576 factory.go:103] Registering Raw factory Jul 05 19:30:01.781546 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.781534 2576 manager.go:1196] Started watching for new ooms in manager Jul 05 19:30:01.782142 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.782131 2576 manager.go:349] Starting recovery of all containers Jul 05 19:30:01.782823 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.782802 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:01.787675 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.787644 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-62.ec2.internal\" not found" node="ip-10-0-142-62.ec2.internal" Jul 05 19:30:01.793587 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.793443 2576 manager.go:354] Recovery completed Jul 05 19:30:01.797810 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.797798 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:01.799645 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.799632 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:01.799692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.799658 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:01.799692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.799669 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:01.800182 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800163 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 19:30:01.800182 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800180 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 19:30:01.800280 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800188 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:01.800280 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800200 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 05 19:30:01.800848 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800836 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:01.800894 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800857 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:01.800894 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.800867 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:01.802290 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.802276 2576 policy_none.go:49] "None policy: Start" Jul 05 19:30:01.802335 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.802300 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 19:30:01.802335 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.802311 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 19:30:01.804214 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.804203 2576 policy_none.go:47] "Start" Jul 05 19:30:01.842733 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.842718 2576 manager.go:337] "Starting Device Plugin manager" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.842749 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.842762 2576 server.go:87] "Starting device plugin registration server" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.843018 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.843031 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.843290 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.843389 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.843402 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.843768 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 19:30:01.864193 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.843811 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:01.905179 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.905136 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 19:30:01.906518 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.906500 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 19:30:01.906577 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.906547 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 19:30:01.906622 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.906578 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 19:30:01.906663 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.906620 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 19:30:01.909206 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.909182 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:01.943364 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.943315 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:01.944125 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.944108 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:01.944215 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.944142 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:01.944215 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.944168 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:01.944215 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.944192 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-62.ec2.internal" Jul 05 19:30:01.953918 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:01.953901 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-62.ec2.internal" Jul 05 19:30:01.953964 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.953922 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-62.ec2.internal\": node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:01.966566 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:01.966546 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.007677 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.007618 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"] Jul 05 19:30:02.007807 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.007721 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:02.008676 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.008661 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:02.008741 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.008690 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:02.008741 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.008700 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:02.011000 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.010986 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:02.011108 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.011172 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011124 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:02.011897 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011883 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:02.011964 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011908 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:02.011964 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011918 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:02.012026 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011887 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:02.012026 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.011987 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:02.012026 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.012003 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:02.014306 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.014291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.014433 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.014316 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 19:30:02.014983 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.014969 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory" Jul 05 19:30:02.015070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.014989 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 19:30:02.015070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.014999 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID" Jul 05 19:30:02.028698 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.028677 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-62.ec2.internal\" not found" node="ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.032498 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.032482 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-62.ec2.internal\" not found" node="ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.066629 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.066605 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.083588 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.083565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.083673 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.083590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.083673 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.083606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa989e2b9c54417bc1c6df0ae2205504-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"fa989e2b9c54417bc1c6df0ae2205504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.167692 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.167661 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.184016 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.183980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.184100 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.184038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.184100 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.184076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.184100 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.184091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a7e7c4b65a4f5ee90f46c73a30390f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"98a7e7c4b65a4f5ee90f46c73a30390f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.184227 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.184099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa989e2b9c54417bc1c6df0ae2205504-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"fa989e2b9c54417bc1c6df0ae2205504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.184227 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.184125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa989e2b9c54417bc1c6df0ae2205504-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"fa989e2b9c54417bc1c6df0ae2205504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.268482 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.268414 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.331908 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.331871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.336913 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.336819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:02.368710 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.368678 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.469825 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.469792 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.570269 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.570243 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.670805 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.670776 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.713202 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.713175 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 19:30:02.713781 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.713309 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 19:30:02.713781 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.713349 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 19:30:02.771511 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.771488 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.774432 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.774407 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 19:25:02 +0000 UTC" deadline="2028-04-07 07:25:35.062707008 +0000 UTC" Jul 05 19:30:02.774432 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.774431 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15395h55m32.288279452s" Jul 05 19:30:02.872193 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.872115 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:02.899567 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:02.899523 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a7e7c4b65a4f5ee90f46c73a30390f.slice/crio-565faf0fe283df71110d98774a0af40a0307645d591bbf412ec405eb22ffbc2a WatchSource:0}: Error finding container 565faf0fe283df71110d98774a0af40a0307645d591bbf412ec405eb22ffbc2a: Status 404 returned error can't find the container with id 565faf0fe283df71110d98774a0af40a0307645d591bbf412ec405eb22ffbc2a Jul 05 19:30:02.900124 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:02.900103 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa989e2b9c54417bc1c6df0ae2205504.slice/crio-dab639c6c55f7a23dbbe64cb7cfa74b90dc57042d986a52e2a2036485e1315aa WatchSource:0}: Error finding container dab639c6c55f7a23dbbe64cb7cfa74b90dc57042d986a52e2a2036485e1315aa: Status 404 returned error can't find the container with id dab639c6c55f7a23dbbe64cb7cfa74b90dc57042d986a52e2a2036485e1315aa Jul 05 19:30:02.904804 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.904791 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:30:02.910317 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.910274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"98a7e7c4b65a4f5ee90f46c73a30390f","Type":"ContainerStarted","Data":"565faf0fe283df71110d98774a0af40a0307645d591bbf412ec405eb22ffbc2a"} Jul 05 19:30:02.911681 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.911657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" event={"ID":"fa989e2b9c54417bc1c6df0ae2205504","Type":"ContainerStarted","Data":"dab639c6c55f7a23dbbe64cb7cfa74b90dc57042d986a52e2a2036485e1315aa"} Jul 05 19:30:02.963816 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:02.963739 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:02.972670 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:02.972649 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:03.073188 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.073161 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:03.173673 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.173595 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:03.274458 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.274419 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found" Jul 05 19:30:03.306369 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.306342 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:03.380842 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.380813 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" Jul 05 19:30:03.390593 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.390493 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 19:30:03.392465 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.392260 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" Jul 05 19:30:03.397705 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.397672 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 19:30:03.757107 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.757066 2576 apiserver.go:52] "Watching apiserver" Jul 05 19:30:03.763270 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.763245 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 19:30:03.764708 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.764683 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hz2tx","openshift-multus/multus-xtsvm","openshift-network-diagnostics/network-check-target-h5b5p","openshift-ovn-kubernetes/ovnkube-node-zb7hm","kube-system/global-pull-secret-syncer-zrkl7","kube-system/konnectivity-agent-lj5gq","kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal","openshift-dns/node-resolver-lrb5s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal","openshift-multus/network-metrics-daemon-phtw8","openshift-network-operator/iptables-alerter-8flpp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2","openshift-cluster-node-tuning-operator/tuned-mtr4b","openshift-image-registry/node-ca-5wzf9"] Jul 05 19:30:03.767703 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.767676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.767820 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.767794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:03.769975 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.769945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.772271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.772250 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.772442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.772423 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.772490 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.772477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hnlqg\"" Jul 05 19:30:03.773261 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.773237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:03.773369 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.773322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:03.775915 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.775891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.778945 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.778921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 19:30:03.779152 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779130 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 19:30:03.779257 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 19:30:03.779257 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 19:30:03.779347 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779289 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v7q4h\"" Jul 05 19:30:03.779497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.779614 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.779614 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.779725 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.779654 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:03.779725 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.779664 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 19:30:03.781372 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.781353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.783698 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.783453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 19:30:03.783698 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.783490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-92clt\"" Jul 05 19:30:03.783856 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.783808 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 19:30:03.784113 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.784091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:03.786065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.786043 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 19:30:03.786169 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.786136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q8qvg\"" Jul 05 19:30:03.786319 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.786299 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.786402 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.786381 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.786863 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.786629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:03.789062 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.788844 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5lcm9\"" Jul 05 19:30:03.789062 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.788934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.789265 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.789137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.789382 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.789366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.791930 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.791912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.794332 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.794313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.794442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.794374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jg89k\"" Jul 05 19:30:03.794442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.794424 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 19:30:03.795027 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795009 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.795367 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-env-overrides\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.795420 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795386 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 19:30:03.795420 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-kubelet-config\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.795507 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysconfig\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.795507 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pjjsq\"" Jul 05 19:30:03.795632 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-host\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.795686 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.795737 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-ovn\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.795849 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795831 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 19:30:03.795902 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-log-socket\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.795975 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-script-lib\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.796030 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6046108d-0beb-4a3b-b912-c507e6648305-konnectivity-ca\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.796109 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vtjk\" (UniqueName: \"kubernetes.io/projected/d744635e-67c3-4f97-82c5-52cd1d516078-kube-api-access-8vtjk\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.796148 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.795688 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 19:30:03.796148 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-sys\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796377 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.796481 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.796581 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-dbus\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.796638 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796617 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 19:30:03.796732 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-kubernetes\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796794 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-conf\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796842 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-systemd\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796842 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-run\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796919 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-lib-modules\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.796974 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:03.796974 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-kubelet\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797076 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.796981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-systemd-units\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797076 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-systemd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797076 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-var-lib-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/845245a7-1041-40f8-be6f-72eee8565ca0-ovn-node-metrics-cert\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:03.797250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-tuned\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-tmp\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-config\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzvr\" (UniqueName: \"kubernetes.io/projected/845245a7-1041-40f8-be6f-72eee8565ca0-kube-api-access-zpzvr\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6046108d-0beb-4a3b-b912-c507e6648305-agent-certs\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-etc-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.797509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-modprobe-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-slash\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-netns\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-node-log\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-bin\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-var-lib-kubelet\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fjc\" (UniqueName: \"kubernetes.io/projected/00c1abe9-949d-4f3d-8614-ceeb1e03afee-kube-api-access-z7fjc\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.797852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.797787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-netd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.799297 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.799274 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.799400 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.799316 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 19:30:03.799467 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.799431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.799525 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.799486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nw77c\"" Jul 05 19:30:03.799694 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.799674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.801746 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.801725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 19:30:03.801963 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.801946 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 19:30:03.802168 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.802072 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 19:30:03.802317 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.802174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j9z7w\"" Jul 05 19:30:03.816097 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.816076 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6zm6j" Jul 05 19:30:03.816489 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.816467 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:03.823495 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.823474 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6zm6j" Jul 05 19:30:03.882082 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.882056 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 19:30:03.898503 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-log-socket\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-script-lib\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6046108d-0beb-4a3b-b912-c507e6648305-konnectivity-ca\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vtjk\" (UniqueName: \"kubernetes.io/projected/d744635e-67c3-4f97-82c5-52cd1d516078-kube-api-access-8vtjk\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-sys\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-log-socket\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-system-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.898654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzkm\" (UniqueName: \"kubernetes.io/projected/b15cf900-0d65-4321-ba9c-7a4d5496e200-kube-api-access-5lzkm\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-sys\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-kubernetes\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-conf\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-run\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-tuned\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnx2s\" (UniqueName: \"kubernetes.io/projected/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-kube-api-access-lnx2s\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-cni-binary-copy\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-bin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-var-lib-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.898991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-multus-certs\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.899024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-etc-kubernetes\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624cb5fb-c066-4617-aac8-13ddd5f5da43-host-slash\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-run\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-script-lib\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqbk\" (UniqueName: \"kubernetes.io/projected/be408c43-486e-4732-8d4e-81504ddf5fdc-kube-api-access-trqbk\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6046108d-0beb-4a3b-b912-c507e6648305-konnectivity-ca\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-config\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-var-lib-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6046108d-0beb-4a3b-b912-c507e6648305-agent-certs\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125ebdae-6bea-43a9-863d-065316cb1f3f-serviceca\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-modprobe-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-os-release\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-netns\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-bin\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.899774 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-var-lib-kubelet\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fjc\" (UniqueName: \"kubernetes.io/projected/00c1abe9-949d-4f3d-8614-ceeb1e03afee-kube-api-access-z7fjc\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899538 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-cnibin\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-netd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-var-lib-kubelet\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-netd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-conf\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-modprobe-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysctl-d\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.899981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-netns\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-env-overrides\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-kubernetes\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-kubelet-config\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-cni-bin\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysconfig\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.900648 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-host\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-hosts-file\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-cnibin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-k8s-cni-cncf-io\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900300 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-ovnkube-config\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-conf-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-kubelet-config\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-sysconfig\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-host\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-netns\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-ovn\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/845245a7-1041-40f8-be6f-72eee8565ca0-env-overrides\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-ovn\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.901553 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-socket-dir-parent\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2v7\" (UniqueName: \"kubernetes.io/projected/83018d8d-1ebc-49ae-b28e-028e570dc010-kube-api-access-vr2v7\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125ebdae-6bea-43a9-863d-065316cb1f3f-host\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-dbus\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-systemd\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-lib-modules\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-tmp\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmp6j\" (UniqueName: \"kubernetes.io/projected/125ebdae-6bea-43a9-863d-065316cb1f3f-kube-api-access-fmp6j\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-kubelet\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-systemd-units\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-lib-modules\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-systemd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.900985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/845245a7-1041-40f8-be6f-72eee8565ca0-ovn-node-metrics-cert\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-run-systemd\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.902636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b24635a-4786-43cd-8848-b17846a11b8e-dbus\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzvr\" (UniqueName: \"kubernetes.io/projected/845245a7-1041-40f8-be6f-72eee8565ca0-kube-api-access-zpzvr\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-systemd\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-tmp-dir\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-kubelet\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-multus\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-systemd-units\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.901321 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.901403 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:04.401368221 +0000 UTC m=+3.028556652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-etc-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.901974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624cb5fb-c066-4617-aac8-13ddd5f5da43-iptables-alerter-script\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-device-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-etc-openvswitch\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.903536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-slash\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-node-log\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.902120 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-os-release\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.902198 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:04.402179903 +0000 UTC m=+3.029368340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-node-log\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/845245a7-1041-40f8-be6f-72eee8565ca0-host-slash\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-kubelet\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-hostroot\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpg7v\" (UniqueName: \"kubernetes.io/projected/624cb5fb-c066-4617-aac8-13ddd5f5da43-kube-api-access-rpg7v\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-daemon-config\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:03.904185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.902414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-system-cni-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:03.904836 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.904468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-etc-tuned\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.904836 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.904491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c1abe9-949d-4f3d-8614-ceeb1e03afee-tmp\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.904836 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.904596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/845245a7-1041-40f8-be6f-72eee8565ca0-ovn-node-metrics-cert\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:03.910128 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.910098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6046108d-0beb-4a3b-b912-c507e6648305-agent-certs\") pod \"konnectivity-agent-lj5gq\" (UID: \"6046108d-0beb-4a3b-b912-c507e6648305\") " pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:03.910496 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.910468 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:03.910600 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.910501 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:03.910600 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.910516 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:03.910766 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:03.910751 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:04.41073299 +0000 UTC m=+3.037921439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:03.911714 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.911686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vtjk\" (UniqueName: \"kubernetes.io/projected/d744635e-67c3-4f97-82c5-52cd1d516078-kube-api-access-8vtjk\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:03.913526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.913498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fjc\" (UniqueName: \"kubernetes.io/projected/00c1abe9-949d-4f3d-8614-ceeb1e03afee-kube-api-access-z7fjc\") pod \"tuned-mtr4b\" (UID: \"00c1abe9-949d-4f3d-8614-ceeb1e03afee\") " pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:03.914999 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:03.914973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzvr\" (UniqueName: \"kubernetes.io/projected/845245a7-1041-40f8-be6f-72eee8565ca0-kube-api-access-zpzvr\") pod \"ovnkube-node-zb7hm\" (UID: \"845245a7-1041-40f8-be6f-72eee8565ca0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:04.003599 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnx2s\" (UniqueName: \"kubernetes.io/projected/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-kube-api-access-lnx2s\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.003599 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-cni-binary-copy\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-bin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-multus-certs\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-etc-kubernetes\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624cb5fb-c066-4617-aac8-13ddd5f5da43-host-slash\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-bin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-multus-certs\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-etc-kubernetes\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624cb5fb-c066-4617-aac8-13ddd5f5da43-host-slash\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqbk\" (UniqueName: \"kubernetes.io/projected/be408c43-486e-4732-8d4e-81504ddf5fdc-kube-api-access-trqbk\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.003870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125ebdae-6bea-43a9-863d-065316cb1f3f-serviceca\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.003946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-os-release\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-cnibin\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-hosts-file\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-cnibin\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-cnibin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-k8s-cni-cncf-io\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-cnibin\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-hosts-file\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-k8s-cni-cncf-io\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-conf-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-os-release\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-netns\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.004501 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-conf-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-cni-binary-copy\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-socket-dir-parent\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125ebdae-6bea-43a9-863d-065316cb1f3f-serviceca\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004321 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-run-netns\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-socket-dir-parent\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2v7\" (UniqueName: \"kubernetes.io/projected/83018d8d-1ebc-49ae-b28e-028e570dc010-kube-api-access-vr2v7\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125ebdae-6bea-43a9-863d-065316cb1f3f-host\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmp6j\" (UniqueName: \"kubernetes.io/projected/125ebdae-6bea-43a9-863d-065316cb1f3f-kube-api-access-fmp6j\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125ebdae-6bea-43a9-863d-065316cb1f3f-host\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-tmp-dir\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-multus\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.005460 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624cb5fb-c066-4617-aac8-13ddd5f5da43-iptables-alerter-script\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-device-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-os-release\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-kubelet\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-hostroot\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpg7v\" (UniqueName: \"kubernetes.io/projected/624cb5fb-c066-4617-aac8-13ddd5f5da43-kube-api-access-rpg7v\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-daemon-config\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-system-cni-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-system-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzkm\" (UniqueName: \"kubernetes.io/projected/b15cf900-0d65-4321-ba9c-7a4d5496e200-kube-api-access-5lzkm\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-tmp-dir\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.004964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-device-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-os-release\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006143 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624cb5fb-c066-4617-aac8-13ddd5f5da43-iptables-alerter-script\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-cni-multus\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005518 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15cf900-0d65-4321-ba9c-7a4d5496e200-multus-daemon-config\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83018d8d-1ebc-49ae-b28e-028e570dc010-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-hostroot\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-host-var-lib-kubelet\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be408c43-486e-4732-8d4e-81504ddf5fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83018d8d-1ebc-49ae-b28e-028e570dc010-system-cni-dir\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.006867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.005693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15cf900-0d65-4321-ba9c-7a4d5496e200-system-cni-dir\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.013365 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.013252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmp6j\" (UniqueName: \"kubernetes.io/projected/125ebdae-6bea-43a9-863d-065316cb1f3f-kube-api-access-fmp6j\") pod \"node-ca-5wzf9\" (UID: \"125ebdae-6bea-43a9-863d-065316cb1f3f\") " pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.013496 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.013456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2v7\" (UniqueName: \"kubernetes.io/projected/83018d8d-1ebc-49ae-b28e-028e570dc010-kube-api-access-vr2v7\") pod \"multus-additional-cni-plugins-hz2tx\" (UID: \"83018d8d-1ebc-49ae-b28e-028e570dc010\") " pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.018703 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.018676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnx2s\" (UniqueName: \"kubernetes.io/projected/5a45373c-bccf-4ed7-9d15-b1df4935fa2c-kube-api-access-lnx2s\") pod \"node-resolver-lrb5s\" (UID: \"5a45373c-bccf-4ed7-9d15-b1df4935fa2c\") " pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.018833 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.018810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzkm\" (UniqueName: \"kubernetes.io/projected/b15cf900-0d65-4321-ba9c-7a4d5496e200-kube-api-access-5lzkm\") pod \"multus-xtsvm\" (UID: \"b15cf900-0d65-4321-ba9c-7a4d5496e200\") " pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.018879 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.018810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpg7v\" (UniqueName: \"kubernetes.io/projected/624cb5fb-c066-4617-aac8-13ddd5f5da43-kube-api-access-rpg7v\") pod \"iptables-alerter-8flpp\" (UID: \"624cb5fb-c066-4617-aac8-13ddd5f5da43\") " pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.020474 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.020451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqbk\" (UniqueName: \"kubernetes.io/projected/be408c43-486e-4732-8d4e-81504ddf5fdc-kube-api-access-trqbk\") pod \"aws-ebs-csi-driver-node-rw4k2\" (UID: \"be408c43-486e-4732-8d4e-81504ddf5fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.082450 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.082415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" Jul 05 19:30:04.093089 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.093067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:04.108122 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.108097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:04.113949 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.113924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wzf9" Jul 05 19:30:04.122094 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.122068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrb5s" Jul 05 19:30:04.130042 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.130013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xtsvm" Jul 05 19:30:04.138106 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.138087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" Jul 05 19:30:04.147996 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.147971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8flpp" Jul 05 19:30:04.153881 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.153862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" Jul 05 19:30:04.268376 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.268274 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 19:30:04.407538 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.407503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:04.407538 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.407541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:04.407779 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.407673 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:04.407779 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.407675 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:04.407779 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.407746 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:05.407723535 +0000 UTC m=+4.034912003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:04.407779 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.407767 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:05.40775656 +0000 UTC m=+4.034944995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:04.509062 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.509027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:04.509264 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.509244 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:04.509372 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.509276 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:04.509372 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.509293 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:04.509372 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.509368 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:05.509345687 +0000 UTC m=+4.136534140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:04.827570 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.827524 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:25:04 +0000 UTC" deadline="2028-02-09 20:11:47.701762313 +0000 UTC" Jul 05 19:30:04.827570 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.827567 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14016h41m42.87420059s" Jul 05 19:30:04.843471 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.843443 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c1abe9_949d_4f3d_8614_ceeb1e03afee.slice/crio-2793cadb186b889c490591dae694c7ef07ea3a1f60b0427cfb0c8f35768b56af WatchSource:0}: Error finding container 2793cadb186b889c490591dae694c7ef07ea3a1f60b0427cfb0c8f35768b56af: Status 404 returned error can't find the container with id 2793cadb186b889c490591dae694c7ef07ea3a1f60b0427cfb0c8f35768b56af Jul 05 19:30:04.847762 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.847733 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15cf900_0d65_4321_ba9c_7a4d5496e200.slice/crio-5da2a53f3d1bff493805ee0d2987abd3c69ed6728f2bada94bb855974048e21d WatchSource:0}: Error finding container 5da2a53f3d1bff493805ee0d2987abd3c69ed6728f2bada94bb855974048e21d: Status 404 returned error can't find the container with id 5da2a53f3d1bff493805ee0d2987abd3c69ed6728f2bada94bb855974048e21d Jul 05 19:30:04.873433 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.873396 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624cb5fb_c066_4617_aac8_13ddd5f5da43.slice/crio-665f2d4887fa98c97cb52196d2ba52f1805136f295aa1b85d4e10427953cd1f1 WatchSource:0}: Error finding container 665f2d4887fa98c97cb52196d2ba52f1805136f295aa1b85d4e10427953cd1f1: Status 404 returned error can't find the container with id 665f2d4887fa98c97cb52196d2ba52f1805136f295aa1b85d4e10427953cd1f1 Jul 05 19:30:04.874447 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.874421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a45373c_bccf_4ed7_9d15_b1df4935fa2c.slice/crio-4bb4abea039ab8aa3aee35ed26474bdc0f180d9128d83ede4d262225ce733f6b WatchSource:0}: Error finding container 4bb4abea039ab8aa3aee35ed26474bdc0f180d9128d83ede4d262225ce733f6b: Status 404 returned error can't find the container with id 4bb4abea039ab8aa3aee35ed26474bdc0f180d9128d83ede4d262225ce733f6b Jul 05 19:30:04.875860 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.875807 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845245a7_1041_40f8_be6f_72eee8565ca0.slice/crio-aa957f3a304c8757d134252100198c911549584c9cd5618914d4aeefc25f72fe WatchSource:0}: Error finding container aa957f3a304c8757d134252100198c911549584c9cd5618914d4aeefc25f72fe: Status 404 returned error can't find the container with id aa957f3a304c8757d134252100198c911549584c9cd5618914d4aeefc25f72fe Jul 05 19:30:04.878437 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.878377 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83018d8d_1ebc_49ae_b28e_028e570dc010.slice/crio-593a69bc4407bf6292aaef629c3f613337a2a92f4746926bafedbe5e4e06b7e3 WatchSource:0}: Error finding container 593a69bc4407bf6292aaef629c3f613337a2a92f4746926bafedbe5e4e06b7e3: Status 404 returned error can't find the container with id 593a69bc4407bf6292aaef629c3f613337a2a92f4746926bafedbe5e4e06b7e3 Jul 05 19:30:04.878675 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.878654 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe408c43_486e_4732_8d4e_81504ddf5fdc.slice/crio-cf31abf3722b35ad493d5c4c06099272746143e1015f3f960135367a576be5e9 WatchSource:0}: Error finding container cf31abf3722b35ad493d5c4c06099272746143e1015f3f960135367a576be5e9: Status 404 returned error can't find the container with id cf31abf3722b35ad493d5c4c06099272746143e1015f3f960135367a576be5e9 Jul 05 19:30:04.881624 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:04.881173 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125ebdae_6bea_43a9_863d_065316cb1f3f.slice/crio-f62491d01f7bffb0b6e4cc70e88949e6ed67d1ace3ffb319692f1e690143aa72 WatchSource:0}: Error finding container f62491d01f7bffb0b6e4cc70e88949e6ed67d1ace3ffb319692f1e690143aa72: Status 404 returned error can't find the container with id f62491d01f7bffb0b6e4cc70e88949e6ed67d1ace3ffb319692f1e690143aa72 Jul 05 19:30:04.918962 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.910196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:04.919131 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:04.919100 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:04.921591 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.921568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" event={"ID":"be408c43-486e-4732-8d4e-81504ddf5fdc","Type":"ContainerStarted","Data":"cf31abf3722b35ad493d5c4c06099272746143e1015f3f960135367a576be5e9"} Jul 05 19:30:04.922925 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.922875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerStarted","Data":"593a69bc4407bf6292aaef629c3f613337a2a92f4746926bafedbe5e4e06b7e3"} Jul 05 19:30:04.924100 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.924076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrb5s" event={"ID":"5a45373c-bccf-4ed7-9d15-b1df4935fa2c","Type":"ContainerStarted","Data":"4bb4abea039ab8aa3aee35ed26474bdc0f180d9128d83ede4d262225ce733f6b"} Jul 05 19:30:04.925478 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.925458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8flpp" event={"ID":"624cb5fb-c066-4617-aac8-13ddd5f5da43","Type":"ContainerStarted","Data":"665f2d4887fa98c97cb52196d2ba52f1805136f295aa1b85d4e10427953cd1f1"} Jul 05 19:30:04.926654 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.926633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xtsvm" event={"ID":"b15cf900-0d65-4321-ba9c-7a4d5496e200","Type":"ContainerStarted","Data":"5da2a53f3d1bff493805ee0d2987abd3c69ed6728f2bada94bb855974048e21d"} Jul 05 19:30:04.927830 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.927809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" event={"ID":"00c1abe9-949d-4f3d-8614-ceeb1e03afee","Type":"ContainerStarted","Data":"2793cadb186b889c490591dae694c7ef07ea3a1f60b0427cfb0c8f35768b56af"} Jul 05 19:30:04.928995 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.928974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wzf9" event={"ID":"125ebdae-6bea-43a9-863d-065316cb1f3f","Type":"ContainerStarted","Data":"f62491d01f7bffb0b6e4cc70e88949e6ed67d1ace3ffb319692f1e690143aa72"} Jul 05 19:30:04.930917 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.930897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"aa957f3a304c8757d134252100198c911549584c9cd5618914d4aeefc25f72fe"} Jul 05 19:30:04.932381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:04.932356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lj5gq" event={"ID":"6046108d-0beb-4a3b-b912-c507e6648305","Type":"ContainerStarted","Data":"5e7792b75483be26c84354a53a8a41adacbbd7bf8eb416e0867b85d3b6c6361f"} Jul 05 19:30:05.417357 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.417251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:05.417357 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.417331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:05.421509 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.421478 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:05.421636 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.421584 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:07.421561126 +0000 UTC m=+6.048749560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:05.422330 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.422300 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:05.422448 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.422387 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:07.422366498 +0000 UTC m=+6.049554932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:05.518389 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.518343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:05.518648 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.518610 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:05.518648 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.518631 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:05.518648 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.518645 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:05.518829 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.518709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:07.51868936 +0000 UTC m=+6.145877806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:05.828245 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.828145 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:25:04 +0000 UTC" deadline="2028-02-13 00:48:33.59546802 +0000 UTC" Jul 05 19:30:05.828245 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.828235 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h18m27.767238608s" Jul 05 19:30:05.909508 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.909464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:05.909721 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.909692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:05.910152 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.910130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:05.910465 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:05.910408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:05.974128 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.974085 2576 generic.go:356] "Generic (PLEG): container finished" podID="98a7e7c4b65a4f5ee90f46c73a30390f" containerID="30df19900c6bae5ce601c35472cd73bad3202766c797e1914a236afb5a088424" exitCode=0 Jul 05 19:30:05.974356 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.974188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"98a7e7c4b65a4f5ee90f46c73a30390f","Type":"ContainerDied","Data":"30df19900c6bae5ce601c35472cd73bad3202766c797e1914a236afb5a088424"} Jul 05 19:30:05.983447 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:05.983388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" event={"ID":"fa989e2b9c54417bc1c6df0ae2205504","Type":"ContainerStarted","Data":"d5f4018c3f24168f5d72bd8df2a1455de548b95c2b76fde74b4a9f890fa6b542"} Jul 05 19:30:06.001856 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:06.001797 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" podStartSLOduration=3.001775414 podStartE2EDuration="3.001775414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:06.001266473 +0000 UTC m=+4.628454928" watchObservedRunningTime="2026-07-05 19:30:06.001775414 +0000 UTC m=+4.628963870" Jul 05 19:30:06.907122 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:06.907086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:06.907673 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:06.907264 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:06.994496 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:06.994459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"98a7e7c4b65a4f5ee90f46c73a30390f","Type":"ContainerStarted","Data":"1e9df908ce11566029b7018c5e554fa145cdbdd7e3d1a886d8e32a60e4c4410f"} Jul 05 19:30:07.010347 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.009342 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" podStartSLOduration=4.009318769 podStartE2EDuration="4.009318769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:07.008949615 +0000 UTC m=+5.636138078" watchObservedRunningTime="2026-07-05 19:30:07.009318769 +0000 UTC m=+5.636507226" Jul 05 19:30:07.434471 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.434407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:07.434471 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.434459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:07.434730 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.434618 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:07.434730 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.434686 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:11.434665528 +0000 UTC m=+10.061853980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:07.435113 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.435089 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:07.435266 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.435145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:11.435129889 +0000 UTC m=+10.062318336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:07.536180 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.535529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:07.536180 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.535714 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:07.536180 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.535737 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:07.536180 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.535751 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:07.536180 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.535821 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:11.535797064 +0000 UTC m=+10.162985514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:07.907318 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.907287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:07.907838 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:07.907332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:07.907838 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.907434 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:07.907838 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:07.907551 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:08.907139 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:08.907099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:08.907367 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:08.907267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:09.909360 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:09.909320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:09.909844 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:09.909464 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:09.909844 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:09.909515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:09.909844 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:09.909649 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:10.907185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:10.906980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:10.907185 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:10.907093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:11.469121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:11.469189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.469327 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.469392 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:19.469372966 +0000 UTC m=+18.096561400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.469761 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:11.469852 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.469816 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:19.469800092 +0000 UTC m=+18.096988523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:11.569876 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:11.569839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:11.570076 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.570035 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:11.570076 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.570057 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:11.570076 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.570069 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:11.570279 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.570129 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:19.570111308 +0000 UTC m=+18.197299758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:11.907783 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:11.907750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:11.907928 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.907841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:11.908247 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:11.908222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:11.908382 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:11.908322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:12.907399 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:12.906912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:12.907399 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:12.907039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:13.907776 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:13.907245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:13.907776 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:13.907369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:13.908328 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:13.907903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:13.908328 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:13.908010 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:14.907032 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:14.906995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:14.907230 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:14.907127 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:15.907675 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:15.907161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:15.907675 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:15.907297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:15.908182 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:15.907779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:15.908182 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:15.907893 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:16.907572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:16.907524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:16.907731 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:16.907660 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:17.907867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:17.907347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:17.907867 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:17.907483 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:17.907867 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:17.907543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:17.907867 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:17.907669 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:18.906813 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:18.906786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:18.907067 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:18.906918 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:19.530522 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:19.530485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:19.530522 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:19.530534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:19.531006 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.530688 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:19.531006 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.530749 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:30:35.530731239 +0000 UTC m=+34.157919668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:19.531199 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.531182 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:19.531272 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.531240 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:35.531223292 +0000 UTC m=+34.158411721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:19.631772 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:19.631737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:19.631939 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.631843 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:19.631939 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.631862 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:19.631939 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.631871 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:19.631939 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.631929 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:30:35.631913242 +0000 UTC m=+34.259101673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:19.906962 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:19.906926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:19.907138 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:19.906927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:19.907138 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.907072 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:19.907273 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:19.907216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:20.907751 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:20.907717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:20.908184 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:20.907864 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:21.907884 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:21.907849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:21.908283 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:21.907923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:21.908283 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:21.907936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:21.908283 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:21.908022 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:22.907624 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:22.907591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:22.907780 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:22.907697 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:23.907857 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:23.907825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:23.908352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:23.907825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:23.908352 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:23.907945 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:23.908352 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:23.908024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:24.906940 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:24.906758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:24.907048 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:24.907027 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:25.036031 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.035997 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wzf9" event={"ID":"125ebdae-6bea-43a9-863d-065316cb1f3f","Type":"ContainerStarted","Data":"00127f1a76df0d60ae9a287d28d4db3f1a4e35775f0f082753911edf87d42f3b"} Jul 05 19:30:25.041682 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"e458ea199e21d1d3e3fbb3f9efd406cd39156f81a748ea487df4ff97d6f8c9b9"} Jul 05 19:30:25.041827 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"a51c74b9b2b1d6d1cf9ab1bb1d352c8f1420543966fe2a723da812df506c225f"} Jul 05 19:30:25.041827 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"8937ef23d4dbec950c84b9d3e1f0ac5e740af486c2e7464ed330b1c54076185b"} Jul 05 19:30:25.041920 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"dd9fac0c9ad51a370083a91b7f2b7d2fdc1531fe6eb90d1470477c35b1b37c76"} Jul 05 19:30:25.041920 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"a97c804f0fc221c5ee9ddd92eae063836bde80b74a3f85fdbb5194601f55d5f0"} Jul 05 19:30:25.041991 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.041966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"523a07378c293b3859a278df1787078a0e9537f8f775e61e9a29cdcc95e0c827"} Jul 05 19:30:25.045709 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.045447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lj5gq" event={"ID":"6046108d-0beb-4a3b-b912-c507e6648305","Type":"ContainerStarted","Data":"59a6a224355f1dd000b26d98701cba4583f879e595e43abeb4f34f005f348255"} Jul 05 19:30:25.047474 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.047447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" event={"ID":"be408c43-486e-4732-8d4e-81504ddf5fdc","Type":"ContainerStarted","Data":"3cd0f3faa5a273cef35d934640d830bd4cdb3f23eb28ef0b025b43e9046041db"} Jul 05 19:30:25.049233 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.049204 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="0ac36c7fa2fe0b5de927494e390402d155f6703b27624b0bc91c6967365811eb" exitCode=0 Jul 05 19:30:25.049344 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.049288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"0ac36c7fa2fe0b5de927494e390402d155f6703b27624b0bc91c6967365811eb"} Jul 05 19:30:25.051164 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.051132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrb5s" event={"ID":"5a45373c-bccf-4ed7-9d15-b1df4935fa2c","Type":"ContainerStarted","Data":"ca83b6b4b4a3194754c7a9c62a6b1ed8ede12f565a86f76ded0b4cb7303e614e"} Jul 05 19:30:25.053253 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.053218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xtsvm" event={"ID":"b15cf900-0d65-4321-ba9c-7a4d5496e200","Type":"ContainerStarted","Data":"cd85847f607597b6f9927a2e65ee99b7774edb317696fbd86b01d4abb8d91be2"} Jul 05 19:30:25.054987 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.054953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" event={"ID":"00c1abe9-949d-4f3d-8614-ceeb1e03afee","Type":"ContainerStarted","Data":"6d1c53b62c30f0638cf277b74eea7e98cf564cd14f1b2a5619d764e49d42ff02"} Jul 05 19:30:25.062331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.062284 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lj5gq" podStartSLOduration=3.54171813 podStartE2EDuration="23.062266835s" totalImagesPullingTime="19.520548705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:25.061973635 +0000 UTC m=+23.689162088" watchObservedRunningTime="2026-07-05 19:30:25.062266835 +0000 UTC m=+23.689455295" Jul 05 19:30:25.062845 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.062816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5wzf9" podStartSLOduration=3.55703104 podStartE2EDuration="23.062801907s" totalImagesPullingTime="19.505770867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:25.049579566 +0000 UTC m=+23.676768033" watchObservedRunningTime="2026-07-05 19:30:25.062801907 +0000 UTC m=+23.689990362" Jul 05 19:30:25.094994 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.094949 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mtr4b" podStartSLOduration=3.550746054 podStartE2EDuration="23.094934655s" totalImagesPullingTime="19.544188601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:25.094806224 +0000 UTC m=+23.721994677" watchObservedRunningTime="2026-07-05 19:30:25.094934655 +0000 UTC m=+23.722123105" Jul 05 19:30:25.108908 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.108855 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lrb5s" podStartSLOduration=3.595555664 podStartE2EDuration="23.108838939s" totalImagesPullingTime="19.513283275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:25.108517369 +0000 UTC m=+23.735705822" watchObservedRunningTime="2026-07-05 19:30:25.108838939 +0000 UTC m=+23.736027386" Jul 05 19:30:25.125066 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.124854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xtsvm" podStartSLOduration=3.554489962 podStartE2EDuration="23.124832063s" totalImagesPullingTime="19.570342101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:25.124732273 +0000 UTC m=+23.751920717" watchObservedRunningTime="2026-07-05 19:30:25.124832063 +0000 UTC m=+23.752020514" Jul 05 19:30:25.749840 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.749796 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 19:30:25.858652 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.858530 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T19:30:25.749820668Z","UUID":"a2c0f3e3-b9c2-4781-85a9-e6e78982cc74","Handler":null,"Name":"","Endpoint":""} Jul 05 19:30:25.863768 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.863740 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 19:30:25.863928 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.863793 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 19:30:25.907431 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.907396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:25.907608 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:25.907504 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:25.907608 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:25.907572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:25.907727 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:25.907683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:26.058828 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:26.058747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8flpp" event={"ID":"624cb5fb-c066-4617-aac8-13ddd5f5da43","Type":"ContainerStarted","Data":"6882eb4ad7a52126242e1268b003a9e13272b02d7a17f9e94109298f01aa8df5"} Jul 05 19:30:26.061200 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:26.061168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" event={"ID":"be408c43-486e-4732-8d4e-81504ddf5fdc","Type":"ContainerStarted","Data":"0641cdf1e12834f0a87ff0ce5f1bfca05cdfb7f90216c4bcb54f17e240318864"} Jul 05 19:30:26.071872 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:26.071819 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8flpp" podStartSLOduration=4.546432144 podStartE2EDuration="24.071801683s" totalImagesPullingTime="19.525369539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:26.071767136 +0000 UTC m=+24.698955591" watchObservedRunningTime="2026-07-05 19:30:26.071801683 +0000 UTC m=+24.698990134" Jul 05 19:30:26.907163 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:26.907061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:26.907493 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:26.907460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:27.065764 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:27.065715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" event={"ID":"be408c43-486e-4732-8d4e-81504ddf5fdc","Type":"ContainerStarted","Data":"3cbda35b4062b8f19dc541a40e7ad297d497e9de5e55a37278d49d3bc1848cc1"} Jul 05 19:30:27.081270 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:27.081215 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rw4k2" podStartSLOduration=3.458931562 podStartE2EDuration="25.081200057s" totalImagesPullingTime="21.622268495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:27.080732642 +0000 UTC m=+25.707921087" watchObservedRunningTime="2026-07-05 19:30:27.081200057 +0000 UTC m=+25.708388508" Jul 05 19:30:27.907430 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:27.907236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:27.907599 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:27.907233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:27.907599 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:27.907533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:27.907687 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:27.907612 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:28.071339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:28.071300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"fd12076492eddd995c6c53a2eb05e6945aac18a387b2cb2e40c0df0d6c19cf67"} Jul 05 19:30:28.907274 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:28.907228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:28.907493 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:28.907368 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:28.962129 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:28.962090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:28.962825 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:28.962797 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:29.073445 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:29.073417 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:29.074061 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:29.073946 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lj5gq" Jul 05 19:30:29.907526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:29.907359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:29.907746 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:29.907362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:29.907746 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:29.907604 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:29.907746 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:29.907709 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:30.077598 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.077566 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="363e8477035a665614e8c33d3395c167cafec0be4ba86b628130d63cff052e65" exitCode=0 Jul 05 19:30:30.078271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.077630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"363e8477035a665614e8c33d3395c167cafec0be4ba86b628130d63cff052e65"} Jul 05 19:30:30.081579 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.081554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" event={"ID":"845245a7-1041-40f8-be6f-72eee8565ca0","Type":"ContainerStarted","Data":"aa00dc4cb5fee21e72cecd7dae5953aceb705003846d35c7c3a8431556780feb"} Jul 05 19:30:30.081906 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.081885 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:30.081976 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.081949 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:30.098777 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.098748 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:30.099029 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.099015 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:30.122230 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.121773 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" podStartSLOduration=8.535539675999999 podStartE2EDuration="28.121754305s" totalImagesPullingTime="19.586214629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:30.120484558 +0000 UTC m=+28.747673008" watchObservedRunningTime="2026-07-05 19:30:30.121754305 +0000 UTC m=+28.748942757" Jul 05 19:30:30.907088 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:30.907058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:30.907343 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:30.907201 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:31.084738 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.084709 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:30:31.211940 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.211857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-phtw8"] Jul 05 19:30:31.212181 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.211968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:31.212181 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:31.212080 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:31.214916 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.214889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrkl7"] Jul 05 19:30:31.215020 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.214982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:31.215062 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:31.215049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:31.222671 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.222646 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h5b5p"] Jul 05 19:30:31.222797 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:31.222739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:31.222860 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:31.222841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:32.088500 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:32.088320 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="c80a2736f86dbe21c9befacbc8b26da1472205372f840796e7f746fee9c8ad35" exitCode=0 Jul 05 19:30:32.088999 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:32.088361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"c80a2736f86dbe21c9befacbc8b26da1472205372f840796e7f746fee9c8ad35"} Jul 05 19:30:32.907294 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:32.907262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:32.907472 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:32.907377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:32.907472 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:32.907390 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:32.907472 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:32.907407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:32.907642 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:32.907488 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:32.907642 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:32.907558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:34.095007 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:34.094971 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="2bb9088c5f2089864714df067164629acbf3a12bc6c8959634e9d49bc0f23d49" exitCode=0 Jul 05 19:30:34.095611 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:34.095047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"2bb9088c5f2089864714df067164629acbf3a12bc6c8959634e9d49bc0f23d49"} Jul 05 19:30:34.907339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:34.907305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:34.907339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:34.907330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:34.907568 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:34.907424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:34.907568 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:34.907446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:34.907568 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:34.907522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:34.907682 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:34.907593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:35.545129 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:35.545056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:35.545129 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:35.545095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:35.545698 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.545215 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:35.545698 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.545228 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:35.545698 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.545280 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret podName:5b24635a-4786-43cd-8848-b17846a11b8e nodeName:}" failed. No retries permitted until 2026-07-05 19:31:07.545263881 +0000 UTC m=+66.172452310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret") pod "global-pull-secret-syncer-zrkl7" (UID: "5b24635a-4786-43cd-8848-b17846a11b8e") : object "kube-system"/"original-pull-secret" not registered Jul 05 19:30:35.545698 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.545295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs podName:d744635e-67c3-4f97-82c5-52cd1d516078 nodeName:}" failed. No retries permitted until 2026-07-05 19:31:07.545287835 +0000 UTC m=+66.172476263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs") pod "network-metrics-daemon-phtw8" (UID: "d744635e-67c3-4f97-82c5-52cd1d516078") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 19:30:35.646010 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:35.645973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:35.646202 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.646123 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 19:30:35.646202 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.646141 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 19:30:35.646202 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.646167 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fd989 for pod openshift-network-diagnostics/network-check-target-h5b5p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:35.646336 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:35.646217 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989 podName:67ca764e-e18f-4015-b849-39301605e12d nodeName:}" failed. No retries permitted until 2026-07-05 19:31:07.646205057 +0000 UTC m=+66.273393486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fd989" (UniqueName: "kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989") pod "network-check-target-h5b5p" (UID: "67ca764e-e18f-4015-b849-39301605e12d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 19:30:36.907497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:36.907243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:36.907497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:36.907243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:36.907497 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:36.907383 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phtw8" podUID="d744635e-67c3-4f97-82c5-52cd1d516078" Jul 05 19:30:36.907497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:36.907243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:36.907497 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:36.907433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrkl7" podUID="5b24635a-4786-43cd-8848-b17846a11b8e" Jul 05 19:30:36.907961 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:36.907506 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5b5p" podUID="67ca764e-e18f-4015-b849-39301605e12d" Jul 05 19:30:37.208263 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.208187 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeReady" Jul 05 19:30:37.208414 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.208338 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 19:30:37.252810 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.252778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z4rgc"] Jul 05 19:30:37.257384 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.257360 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t7mvv"] Jul 05 19:30:37.257548 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.257494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.259722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.259699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 19:30:37.259839 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.259731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkl9h\"" Jul 05 19:30:37.259839 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.259734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 19:30:37.260504 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.260487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.262437 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.262415 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 19:30:37.262667 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.262635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8zj4k\"" Jul 05 19:30:37.262750 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.262635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 19:30:37.262823 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.262658 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 19:30:37.265643 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.265622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4rgc"] Jul 05 19:30:37.269458 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.269436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7mvv"] Jul 05 19:30:37.358210 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-config-volume\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.358381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmlj\" (UniqueName: \"kubernetes.io/projected/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-kube-api-access-5qmlj\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.358381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nv2w\" (UniqueName: \"kubernetes.io/projected/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-kube-api-access-5nv2w\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.358381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-cert\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.358516 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.358516 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.358451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-tmp-dir\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.459569 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-config-volume\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.459569 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmlj\" (UniqueName: \"kubernetes.io/projected/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-kube-api-access-5qmlj\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.459569 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv2w\" (UniqueName: \"kubernetes.io/projected/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-kube-api-access-5nv2w\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.459839 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-cert\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.459839 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.459839 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:37.459736 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:37.459839 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:37.459795 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:37.959776475 +0000 UTC m=+36.586964919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:37.460019 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.459850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-tmp-dir\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.460204 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.460175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-config-volume\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.460331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.460238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-tmp-dir\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.464882 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.464718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-cert\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.468851 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.468819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmlj\" (UniqueName: \"kubernetes.io/projected/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-kube-api-access-5qmlj\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.469709 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.469687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nv2w\" (UniqueName: \"kubernetes.io/projected/b5d1c187-38e2-412b-aad6-6b5e6c9ed599-kube-api-access-5nv2w\") pod \"ingress-canary-t7mvv\" (UID: \"b5d1c187-38e2-412b-aad6-6b5e6c9ed599\") " pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.579397 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.579359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7mvv" Jul 05 19:30:37.821210 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.821179 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz"] Jul 05 19:30:37.824372 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.824353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:37.826597 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.826577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bc5cb\"" Jul 05 19:30:37.826713 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.826577 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 05 19:30:37.826713 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.826630 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 05 19:30:37.834121 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.834097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz"] Jul 05 19:30:37.964495 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.964460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83187990-7222-4321-8aad-aed141714e85-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:37.964972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.964508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:37.964972 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:37.964577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:37.964972 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:37.964709 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:37.964972 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:37.964802 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:38.964778331 +0000 UTC m=+37.591966760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:38.066113 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.065878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83187990-7222-4321-8aad-aed141714e85-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:38.066113 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.065912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:38.066113 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.066060 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:38.066113 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.066118 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:38.566094373 +0000 UTC m=+37.193282801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:38.066624 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.066603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83187990-7222-4321-8aad-aed141714e85-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:38.133605 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.133386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7mvv"] Jul 05 19:30:38.138023 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:38.138001 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d1c187_38e2_412b_aad6_6b5e6c9ed599.slice/crio-d9a201090522a23195d652bcfb4d8124d6001da205027a891c75c3ce462aadc5 WatchSource:0}: Error finding container d9a201090522a23195d652bcfb4d8124d6001da205027a891c75c3ce462aadc5: Status 404 returned error can't find the container with id d9a201090522a23195d652bcfb4d8124d6001da205027a891c75c3ce462aadc5 Jul 05 19:30:38.569618 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.569578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:38.569793 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.569710 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:38.569793 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.569771 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:39.569757966 +0000 UTC m=+38.196946395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:38.907051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.907016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:30:38.907354 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.907055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:30:38.907354 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.907052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:30:38.909714 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.909691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 19:30:38.910671 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.910651 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 19:30:38.910788 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.910718 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 19:30:38.910788 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.910742 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 19:30:38.910898 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.910652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvhxs\"" Jul 05 19:30:38.910898 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.910652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-698zg\"" Jul 05 19:30:38.972610 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:38.972578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:38.973024 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.972733 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:38.973024 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:38.972808 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:40.972793164 +0000 UTC m=+39.599981593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:39.109990 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:39.109949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7mvv" event={"ID":"b5d1c187-38e2-412b-aad6-6b5e6c9ed599","Type":"ContainerStarted","Data":"d9a201090522a23195d652bcfb4d8124d6001da205027a891c75c3ce462aadc5"} Jul 05 19:30:39.113284 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:39.113243 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="de9a6f144461b402fc915fb00921688dd357141aa054512146499a86e70073c6" exitCode=0 Jul 05 19:30:39.113431 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:39.113293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"de9a6f144461b402fc915fb00921688dd357141aa054512146499a86e70073c6"} Jul 05 19:30:39.577997 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:39.577787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:39.578213 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:39.577937 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:39.578213 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:39.578087 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:41.578065365 +0000 UTC m=+40.205253794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:40.119350 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:40.119310 2576 generic.go:356] "Generic (PLEG): container finished" podID="83018d8d-1ebc-49ae-b28e-028e570dc010" containerID="99df8448fc0accd7533539cb6aca503ac1696a3b8cd058ae8690338b6b69e843" exitCode=0 Jul 05 19:30:40.119807 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:40.119373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerDied","Data":"99df8448fc0accd7533539cb6aca503ac1696a3b8cd058ae8690338b6b69e843"} Jul 05 19:30:40.989268 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:40.989229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:40.989437 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:40.989398 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:40.989473 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:40.989467 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:44.989451455 +0000 UTC m=+43.616639883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:41.123198 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:41.123103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7mvv" event={"ID":"b5d1c187-38e2-412b-aad6-6b5e6c9ed599","Type":"ContainerStarted","Data":"96035a889027df395577befa2f004ba3ef9f776b25857970ab201d84b08f93fc"} Jul 05 19:30:41.126287 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:41.126262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" event={"ID":"83018d8d-1ebc-49ae-b28e-028e570dc010","Type":"ContainerStarted","Data":"9f6cdacf5cd15b38f609a20456bb74cb208455d7dde053d05098fefa9925da9b"} Jul 05 19:30:41.138720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:41.138679 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t7mvv" podStartSLOduration=1.8571127710000002 podStartE2EDuration="4.138663413s" totalImagesPullingTime="2.281550642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:41.137989742 +0000 UTC m=+39.765178192" watchObservedRunningTime="2026-07-05 19:30:41.138663413 +0000 UTC m=+39.765851863" Jul 05 19:30:41.158860 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:41.158811 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hz2tx" podStartSLOduration=9.469377011 podStartE2EDuration="39.158793091s" totalImagesPullingTime="29.68941608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:41.157786084 +0000 UTC m=+39.784974535" watchObservedRunningTime="2026-07-05 19:30:41.158793091 +0000 UTC m=+39.785981543" Jul 05 19:30:41.592563 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:41.592522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:41.592711 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:41.592674 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:41.592766 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:41.592750 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:45.59273275 +0000 UTC m=+44.219921178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:45.016918 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:45.016880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:45.017438 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:45.017039 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:45.017438 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:45.017119 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:53.0171033 +0000 UTC m=+51.644291729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:45.621251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:45.621209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:45.621412 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:45.621378 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:45.621464 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:45.621453 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:30:53.621433105 +0000 UTC m=+52.248621553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:46.039813 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.039734 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-drfcn"] Jul 05 19:30:46.069878 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.069851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-drfcn"] Jul 05 19:30:46.070064 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.069956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.073365 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.073343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 19:30:46.073572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.073346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rl664\"" Jul 05 19:30:46.074089 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.074067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 19:30:46.074186 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.074098 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 19:30:46.074186 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.074103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 19:30:46.226845 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.226808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.227012 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.226869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-crio-socket\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.227012 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.226894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgtq\" (UniqueName: \"kubernetes.io/projected/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-api-access-lvgtq\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.227012 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.226943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-data-volume\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.227012 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.226989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327636 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-crio-socket\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgtq\" (UniqueName: \"kubernetes.io/projected/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-api-access-lvgtq\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-data-volume\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.327877 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.327748 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:30:46.327877 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.327800 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:30:46.327877 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.327825 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:46.827806404 +0000 UTC m=+45.454994833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:30:46.327877 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.327872 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:46.827843954 +0000 UTC m=+45.455032398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : configmap "kube-rbac-proxy" not found Jul 05 19:30:46.328026 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.327943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-crio-socket\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.328090 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.328076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-data-volume\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.336719 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.336687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgtq\" (UniqueName: \"kubernetes.io/projected/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-api-access-lvgtq\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.770522 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.770441 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn"] Jul 05 19:30:46.801729 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.801696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn"] Jul 05 19:30:46.801894 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.801815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" Jul 05 19:30:46.805777 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.805749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fndpq\"" Jul 05 19:30:46.806586 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.806133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 05 19:30:46.806764 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.806498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 05 19:30:46.831632 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.831606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.831783 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.831702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:46.831783 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.831733 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:30:46.831859 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.831812 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:47.831792786 +0000 UTC m=+46.458981219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : configmap "kube-rbac-proxy" not found Jul 05 19:30:46.831859 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.831831 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:30:46.831935 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:46.831869 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:47.8318594 +0000 UTC m=+46.459047830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:30:46.932928 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:46.932888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq79z\" (UniqueName: \"kubernetes.io/projected/8717e644-0993-4d0e-be39-a664ae84e368-kube-api-access-gq79z\") pod \"migrator-d57d58cc9-c96bn\" (UID: \"8717e644-0993-4d0e-be39-a664ae84e368\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" Jul 05 19:30:47.033741 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.033665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq79z\" (UniqueName: \"kubernetes.io/projected/8717e644-0993-4d0e-be39-a664ae84e368-kube-api-access-gq79z\") pod \"migrator-d57d58cc9-c96bn\" (UID: \"8717e644-0993-4d0e-be39-a664ae84e368\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" Jul 05 19:30:47.043616 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.043592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq79z\" (UniqueName: \"kubernetes.io/projected/8717e644-0993-4d0e-be39-a664ae84e368-kube-api-access-gq79z\") pod \"migrator-d57d58cc9-c96bn\" (UID: \"8717e644-0993-4d0e-be39-a664ae84e368\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" Jul 05 19:30:47.112620 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.112583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" Jul 05 19:30:47.259049 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.259019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn"] Jul 05 19:30:47.261835 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:47.261802 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8717e644_0993_4d0e_be39_a664ae84e368.slice/crio-a93049d315c2cea79f0a52ebb7cb1ffc1ab557e3474ede66f641a8f8e8e111d2 WatchSource:0}: Error finding container a93049d315c2cea79f0a52ebb7cb1ffc1ab557e3474ede66f641a8f8e8e111d2: Status 404 returned error can't find the container with id a93049d315c2cea79f0a52ebb7cb1ffc1ab557e3474ede66f641a8f8e8e111d2 Jul 05 19:30:47.841806 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.841769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:47.842087 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:47.841895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:47.842087 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:47.841916 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:30:47.842087 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:47.841990 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:49.841972869 +0000 UTC m=+48.469161317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : configmap "kube-rbac-proxy" not found Jul 05 19:30:47.842087 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:47.842022 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:30:47.842087 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:47.842077 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:49.842060777 +0000 UTC m=+48.469249227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:30:48.039676 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:48.039650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrb5s_5a45373c-bccf-4ed7-9d15-b1df4935fa2c/dns-node-resolver/0.log" Jul 05 19:30:48.143625 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:48.143531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" event={"ID":"8717e644-0993-4d0e-be39-a664ae84e368","Type":"ContainerStarted","Data":"a93049d315c2cea79f0a52ebb7cb1ffc1ab557e3474ede66f641a8f8e8e111d2"} Jul 05 19:30:49.031547 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.031520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wzf9_125ebdae-6bea-43a9-863d-065316cb1f3f/node-ca/0.log" Jul 05 19:30:49.147883 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.147849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" event={"ID":"8717e644-0993-4d0e-be39-a664ae84e368","Type":"ContainerStarted","Data":"63d5938d30e0b1be4bc1c9373ef94426f836c75e324a6328e1bccef46954b5ac"} Jul 05 19:30:49.148205 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.147899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" event={"ID":"8717e644-0993-4d0e-be39-a664ae84e368","Type":"ContainerStarted","Data":"9459e83fe87bf375fdf9690c3cc2307a562136762a7030e608e10356e7c35c47"} Jul 05 19:30:49.646081 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.646048 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-zmzpx"] Jul 05 19:30:49.669520 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.669491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-zmzpx"] Jul 05 19:30:49.669649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.669578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.672241 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.672216 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 05 19:30:49.672345 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.672273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 05 19:30:49.672646 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.672619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mzkjr\"" Jul 05 19:30:49.672888 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.672874 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 05 19:30:49.673036 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.672957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 05 19:30:49.757211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.757170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-cabundle\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.757211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.757216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjp4\" (UniqueName: \"kubernetes.io/projected/13cbfa8f-a4fe-4a83-a537-581447b362d0-kube-api-access-dnjp4\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.757440 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.757313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-key\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.858397 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.858361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-key\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.858572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.858434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:49.858572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.858454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-cabundle\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.858572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.858470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjp4\" (UniqueName: \"kubernetes.io/projected/13cbfa8f-a4fe-4a83-a537-581447b362d0-kube-api-access-dnjp4\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.858572 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.858506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:49.858572 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:49.858540 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:30:49.858829 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:49.858590 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:30:49.858829 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:49.858615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:53.858596089 +0000 UTC m=+52.485784538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:30:49.858829 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:49.858639 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:30:53.858623864 +0000 UTC m=+52.485812300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : configmap "kube-rbac-proxy" not found Jul 05 19:30:49.859136 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.859120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-cabundle\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.860983 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.860963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13cbfa8f-a4fe-4a83-a537-581447b362d0-signing-key\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.866138 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.866112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjp4\" (UniqueName: \"kubernetes.io/projected/13cbfa8f-a4fe-4a83-a537-581447b362d0-kube-api-access-dnjp4\") pod \"service-ca-758f599c5-zmzpx\" (UID: \"13cbfa8f-a4fe-4a83-a537-581447b362d0\") " pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:49.978014 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:49.977922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-zmzpx" Jul 05 19:30:50.032733 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:50.032682 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7mvv_b5d1c187-38e2-412b-aad6-6b5e6c9ed599/serve-healthcheck-canary/0.log" Jul 05 19:30:50.144962 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:50.144931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-zmzpx"] Jul 05 19:30:50.149500 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:30:50.149460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cbfa8f_a4fe_4a83_a537_581447b362d0.slice/crio-a46beaf0e43251829957dafd6c3a700d862240837784031c665939b90283733c WatchSource:0}: Error finding container a46beaf0e43251829957dafd6c3a700d862240837784031c665939b90283733c: Status 404 returned error can't find the container with id a46beaf0e43251829957dafd6c3a700d862240837784031c665939b90283733c Jul 05 19:30:50.171499 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:50.171449 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-c96bn" podStartSLOduration=2.507774244 podStartE2EDuration="4.171432285s" totalImagesPullingTime="1.663658041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:50.170578659 +0000 UTC m=+48.797767109" watchObservedRunningTime="2026-07-05 19:30:50.171432285 +0000 UTC m=+48.798620735" Jul 05 19:30:51.154226 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:51.154190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-zmzpx" event={"ID":"13cbfa8f-a4fe-4a83-a537-581447b362d0","Type":"ContainerStarted","Data":"a46beaf0e43251829957dafd6c3a700d862240837784031c665939b90283733c"} Jul 05 19:30:53.085013 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.084966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:30:53.085396 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.085117 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 19:30:53.085396 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.085201 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls podName:3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:31:09.085184256 +0000 UTC m=+67.712372685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls") pod "dns-default-z4rgc" (UID: "3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6") : secret "dns-default-metrics-tls" not found Jul 05 19:30:53.160549 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.160518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-zmzpx" event={"ID":"13cbfa8f-a4fe-4a83-a537-581447b362d0","Type":"ContainerStarted","Data":"4c14d07d254dfae852dbe96cc14ad036182df9557cf75dacd9caa90a16656ebe"} Jul 05 19:30:53.177727 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.177674 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-zmzpx" podStartSLOduration=1.991609445 podStartE2EDuration="4.177656365s" totalImagesPullingTime="2.18604692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:30:53.176464256 +0000 UTC m=+51.803652700" watchObservedRunningTime="2026-07-05 19:30:53.177656365 +0000 UTC m=+51.804844816" Jul 05 19:30:53.689853 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.689816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:30:53.690063 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.689972 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 19:30:53.690063 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.690043 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert podName:83187990-7222-4321-8aad-aed141714e85 nodeName:}" failed. No retries permitted until 2026-07-05 19:31:09.690025709 +0000 UTC m=+68.317214139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-2b7fz" (UID: "83187990-7222-4321-8aad-aed141714e85") : secret "networking-console-plugin-cert" not found Jul 05 19:30:53.891687 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.891647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:53.891891 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:30:53.891790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:30:53.891891 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.891805 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 19:30:53.892009 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.891906 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:31:01.891884587 +0000 UTC m=+60.519073031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : configmap "kube-rbac-proxy" not found Jul 05 19:30:53.892009 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.891927 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:30:53.892009 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:30:53.891982 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:31:01.891967333 +0000 UTC m=+60.519155765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:31:01.962833 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:01.962794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:01.963402 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:01.962877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:01.963402 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:31:01.962928 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 19:31:01.963402 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:31:01.962993 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls podName:af74b699-f048-4f84-a8f1-83b2ca4c2d3c nodeName:}" failed. No retries permitted until 2026-07-05 19:31:17.962976347 +0000 UTC m=+76.590164777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-drfcn" (UID: "af74b699-f048-4f84-a8f1-83b2ca4c2d3c") : secret "insights-runtime-extractor-tls" not found Jul 05 19:31:01.963402 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:01.963392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:02.109065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:02.109038 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zb7hm" Jul 05 19:31:07.604602 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.604555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:31:07.604602 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.604612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:31:07.606661 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.606635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 19:31:07.606782 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.606696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 19:31:07.617742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.617716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d744635e-67c3-4f97-82c5-52cd1d516078-metrics-certs\") pod \"network-metrics-daemon-phtw8\" (UID: \"d744635e-67c3-4f97-82c5-52cd1d516078\") " pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:31:07.617866 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.617723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b24635a-4786-43cd-8848-b17846a11b8e-original-pull-secret\") pod \"global-pull-secret-syncer-zrkl7\" (UID: \"5b24635a-4786-43cd-8848-b17846a11b8e\") " pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:31:07.705325 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.705274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:31:07.707541 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.707523 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 19:31:07.718276 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.718253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 19:31:07.726860 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.726837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvhxs\"" Jul 05 19:31:07.728998 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.728979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd989\" (UniqueName: \"kubernetes.io/projected/67ca764e-e18f-4015-b849-39301605e12d-kube-api-access-fd989\") pod \"network-check-target-h5b5p\" (UID: \"67ca764e-e18f-4015-b849-39301605e12d\") " pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:31:07.730759 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.730742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrkl7" Jul 05 19:31:07.735586 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.735562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phtw8" Jul 05 19:31:07.868602 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.868517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrkl7"] Jul 05 19:31:07.872419 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:07.872396 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b24635a_4786_43cd_8848_b17846a11b8e.slice/crio-7d56f9ea07b74d489c613665fb9e4e4f6c7a6d02be80ec65e28bc336abeefc84 WatchSource:0}: Error finding container 7d56f9ea07b74d489c613665fb9e4e4f6c7a6d02be80ec65e28bc336abeefc84: Status 404 returned error can't find the container with id 7d56f9ea07b74d489c613665fb9e4e4f6c7a6d02be80ec65e28bc336abeefc84 Jul 05 19:31:07.880479 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:07.880455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-phtw8"] Jul 05 19:31:07.883760 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:07.883737 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd744635e_67c3_4f97_82c5_52cd1d516078.slice/crio-3c0c87f37521758d3c9ebde81d153c11e25a0cde46d8d334cc8229b00a61787a WatchSource:0}: Error finding container 3c0c87f37521758d3c9ebde81d153c11e25a0cde46d8d334cc8229b00a61787a: Status 404 returned error can't find the container with id 3c0c87f37521758d3c9ebde81d153c11e25a0cde46d8d334cc8229b00a61787a Jul 05 19:31:08.020397 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.020367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-698zg\"" Jul 05 19:31:08.029194 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.029171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:31:08.149466 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.149392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h5b5p"] Jul 05 19:31:08.153314 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:08.153287 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ca764e_e18f_4015_b849_39301605e12d.slice/crio-fdf5ba403bd652423afd4319c509aa779a23e30e1d369fd257cf7d3efbaa0eb0 WatchSource:0}: Error finding container fdf5ba403bd652423afd4319c509aa779a23e30e1d369fd257cf7d3efbaa0eb0: Status 404 returned error can't find the container with id fdf5ba403bd652423afd4319c509aa779a23e30e1d369fd257cf7d3efbaa0eb0 Jul 05 19:31:08.196987 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.196948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrkl7" event={"ID":"5b24635a-4786-43cd-8848-b17846a11b8e","Type":"ContainerStarted","Data":"7d56f9ea07b74d489c613665fb9e4e4f6c7a6d02be80ec65e28bc336abeefc84"} Jul 05 19:31:08.197976 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.197958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h5b5p" event={"ID":"67ca764e-e18f-4015-b849-39301605e12d","Type":"ContainerStarted","Data":"fdf5ba403bd652423afd4319c509aa779a23e30e1d369fd257cf7d3efbaa0eb0"} Jul 05 19:31:08.198971 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:08.198950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phtw8" event={"ID":"d744635e-67c3-4f97-82c5-52cd1d516078","Type":"ContainerStarted","Data":"3c0c87f37521758d3c9ebde81d153c11e25a0cde46d8d334cc8229b00a61787a"} Jul 05 19:31:09.116400 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.116349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:31:09.119426 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.119396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6-metrics-tls\") pod \"dns-default-z4rgc\" (UID: \"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6\") " pod="openshift-dns/dns-default-z4rgc" Jul 05 19:31:09.376585 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.376514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkl9h\"" Jul 05 19:31:09.385395 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.385366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4rgc" Jul 05 19:31:09.566429 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.566304 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4rgc"] Jul 05 19:31:09.572925 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:09.572885 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7fbaad_e1cc_41f7_ad82_8a6c50f944d6.slice/crio-8e61126688d9567e204f5b92b156cda47509a718c49440fb249464911337e1fd WatchSource:0}: Error finding container 8e61126688d9567e204f5b92b156cda47509a718c49440fb249464911337e1fd: Status 404 returned error can't find the container with id 8e61126688d9567e204f5b92b156cda47509a718c49440fb249464911337e1fd Jul 05 19:31:09.720510 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.720412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:31:09.724870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.724844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83187990-7222-4321-8aad-aed141714e85-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2b7fz\" (UID: \"83187990-7222-4321-8aad-aed141714e85\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:31:09.937451 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.937375 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bc5cb\"" Jul 05 19:31:09.946053 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:09.946020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" Jul 05 19:31:10.130066 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.130034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz"] Jul 05 19:31:10.135138 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:10.134795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83187990_7222_4321_8aad_aed141714e85.slice/crio-b5d814d3980e308985a420a2e57dad3854b9be23e56e5e78426a7635cc69bef7 WatchSource:0}: Error finding container b5d814d3980e308985a420a2e57dad3854b9be23e56e5e78426a7635cc69bef7: Status 404 returned error can't find the container with id b5d814d3980e308985a420a2e57dad3854b9be23e56e5e78426a7635cc69bef7 Jul 05 19:31:10.211758 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.211674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phtw8" event={"ID":"d744635e-67c3-4f97-82c5-52cd1d516078","Type":"ContainerStarted","Data":"5a5bfc8c87a58b303697ae2c51f30dbd480166da7e00d32943b0c51f9eb618c3"} Jul 05 19:31:10.211758 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.211741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phtw8" event={"ID":"d744635e-67c3-4f97-82c5-52cd1d516078","Type":"ContainerStarted","Data":"a260be952802affff87eb954ec79472f03182e2d65ded225941bcb597e5c714a"} Jul 05 19:31:10.214907 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.214873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4rgc" event={"ID":"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6","Type":"ContainerStarted","Data":"8e61126688d9567e204f5b92b156cda47509a718c49440fb249464911337e1fd"} Jul 05 19:31:10.217264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.217184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" event={"ID":"83187990-7222-4321-8aad-aed141714e85","Type":"ContainerStarted","Data":"b5d814d3980e308985a420a2e57dad3854b9be23e56e5e78426a7635cc69bef7"} Jul 05 19:31:10.231284 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:10.231223 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-phtw8" podStartSLOduration=66.784832812 podStartE2EDuration="1m8.23120469s" totalImagesPullingTime="1.446371878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:10.230056059 +0000 UTC m=+68.857244511" watchObservedRunningTime="2026-07-05 19:31:10.23120469 +0000 UTC m=+68.858393140" Jul 05 19:31:11.127842 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.127799 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d"] Jul 05 19:31:11.140811 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.140779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.143348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.143323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 05 19:31:11.143659 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.143624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 19:31:11.145023 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.144747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 19:31:11.145023 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.144819 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 05 19:31:11.145023 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.144825 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 05 19:31:11.145361 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.145036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 19:31:11.145599 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.145577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 05 19:31:11.146758 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.146736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d"] Jul 05 19:31:11.232717 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.232877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.232877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.232877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl276\" (UniqueName: \"kubernetes.io/projected/d88bca6f-86d6-42ab-bc02-35081bbee6ab-kube-api-access-rl276\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.232877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88bca6f-86d6-42ab-bc02-35081bbee6ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.232877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.232877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334268 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl276\" (UniqueName: \"kubernetes.io/projected/d88bca6f-86d6-42ab-bc02-35081bbee6ab-kube-api-access-rl276\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88bca6f-86d6-42ab-bc02-35081bbee6ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.334617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.334446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.336048 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.336013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88bca6f-86d6-42ab-bc02-35081bbee6ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.337185 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.337141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-ca\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.337355 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.337334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.337439 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.337414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.337578 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.337563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d88bca6f-86d6-42ab-bc02-35081bbee6ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.343017 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.342990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl276\" (UniqueName: \"kubernetes.io/projected/d88bca6f-86d6-42ab-bc02-35081bbee6ab-kube-api-access-rl276\") pod \"cluster-proxy-proxy-agent-576fbcc9f7-m2t7d\" (UID: \"d88bca6f-86d6-42ab-bc02-35081bbee6ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:11.463103 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:11.463029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" Jul 05 19:31:13.884435 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:13.884069 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d"] Jul 05 19:31:13.890304 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:13.890193 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd88bca6f_86d6_42ab_bc02_35081bbee6ab.slice/crio-d683209da9b5d888f404198fa134062e8f8a57dbd8f061c36bd826397d9635fa WatchSource:0}: Error finding container d683209da9b5d888f404198fa134062e8f8a57dbd8f061c36bd826397d9635fa: Status 404 returned error can't find the container with id d683209da9b5d888f404198fa134062e8f8a57dbd8f061c36bd826397d9635fa Jul 05 19:31:14.236437 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.236400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h5b5p" event={"ID":"67ca764e-e18f-4015-b849-39301605e12d","Type":"ContainerStarted","Data":"60b72d3e1ee96557d2b8099cdc90ca4fd40a5cc2dc9e39d22c55415e48ca0912"} Jul 05 19:31:14.236616 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.236477 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:31:14.238088 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.238058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4rgc" event={"ID":"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6","Type":"ContainerStarted","Data":"9662e5818303c5eeac02b0211668c5cbfa98fbf7c2bc753c4f6d0fc380fd97d3"} Jul 05 19:31:14.238245 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.238116 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z4rgc" Jul 05 19:31:14.238245 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.238135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4rgc" event={"ID":"3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6","Type":"ContainerStarted","Data":"6c7ed929aae959674a9f480964643c85940d11984802cd91b50577c3b2ea7b3d"} Jul 05 19:31:14.239208 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.239187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" event={"ID":"d88bca6f-86d6-42ab-bc02-35081bbee6ab","Type":"ContainerStarted","Data":"d683209da9b5d888f404198fa134062e8f8a57dbd8f061c36bd826397d9635fa"} Jul 05 19:31:14.240536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.240512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" event={"ID":"83187990-7222-4321-8aad-aed141714e85","Type":"ContainerStarted","Data":"d29f526b24e572fb2150b2ef597f98c9a5a72f465d9923bde3025c28cf573b85"} Jul 05 19:31:14.241723 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.241705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrkl7" event={"ID":"5b24635a-4786-43cd-8848-b17846a11b8e","Type":"ContainerStarted","Data":"556052fa7368b9d016ea638fb7ba7bec5a3fa463d8f2fdabacc08eedcd2e6f06"} Jul 05 19:31:14.250876 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.250839 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h5b5p" podStartSLOduration=66.674676598 podStartE2EDuration="1m12.250825768s" totalImagesPullingTime="5.57614917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:14.249934013 +0000 UTC m=+72.877122463" watchObservedRunningTime="2026-07-05 19:31:14.250825768 +0000 UTC m=+72.878014243" Jul 05 19:31:14.266591 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.266551 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z4rgc" podStartSLOduration=33.110482019 podStartE2EDuration="37.266538651s" totalImagesPullingTime="4.156056632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:14.265544108 +0000 UTC m=+72.892732559" watchObservedRunningTime="2026-07-05 19:31:14.266538651 +0000 UTC m=+72.893727102" Jul 05 19:31:14.287283 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.287243 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrkl7" podStartSLOduration=66.429969138 podStartE2EDuration="1m12.287227071s" totalImagesPullingTime="5.857257933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:14.287215037 +0000 UTC m=+72.914403487" watchObservedRunningTime="2026-07-05 19:31:14.287227071 +0000 UTC m=+72.914415522" Jul 05 19:31:14.308667 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:14.308617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2b7fz" podStartSLOduration=33.652343739 podStartE2EDuration="37.308602562s" totalImagesPullingTime="3.656258823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:14.30791346 +0000 UTC m=+72.935101907" watchObservedRunningTime="2026-07-05 19:31:14.308602562 +0000 UTC m=+72.935791036" Jul 05 19:31:18.000714 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.000670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:18.003366 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.003341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af74b699-f048-4f84-a8f1-83b2ca4c2d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drfcn\" (UID: \"af74b699-f048-4f84-a8f1-83b2ca4c2d3c\") " pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:18.182076 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.182045 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rl664\"" Jul 05 19:31:18.190778 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.190751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-drfcn" Jul 05 19:31:18.326955 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.326918 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk"] Jul 05 19:31:18.331909 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.331117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.333835 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.333794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 05 19:31:18.334097 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.334069 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 19:31:18.334576 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.334329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-st4sj\"" Jul 05 19:31:18.334576 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.334329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 05 19:31:18.334576 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.334386 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 19:31:18.334576 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.334429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 19:31:18.338780 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.338758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk"] Jul 05 19:31:18.402893 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.402867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-drfcn"] Jul 05 19:31:18.403089 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.403070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.403131 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.403101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f987fd-7ea2-47f5-a53f-620dfc939fba-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.403131 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.403119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrng\" (UniqueName: \"kubernetes.io/projected/37f987fd-7ea2-47f5-a53f-620dfc939fba-kube-api-access-2jrng\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.403254 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.403141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.405884 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:18.405862 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf74b699_f048_4f84_a8f1_83b2ca4c2d3c.slice/crio-1a7b54de84d1d882363b6848e4648b6089b6df53b6390b196d9a12d6f5cc2c42 WatchSource:0}: Error finding container 1a7b54de84d1d882363b6848e4648b6089b6df53b6390b196d9a12d6f5cc2c42: Status 404 returned error can't find the container with id 1a7b54de84d1d882363b6848e4648b6089b6df53b6390b196d9a12d6f5cc2c42 Jul 05 19:31:18.503982 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.503953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.504098 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.503996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f987fd-7ea2-47f5-a53f-620dfc939fba-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.504296 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.504267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrng\" (UniqueName: \"kubernetes.io/projected/37f987fd-7ea2-47f5-a53f-620dfc939fba-kube-api-access-2jrng\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.504384 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.504342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.504505 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:31:18.504483 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 05 19:31:18.504571 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:31:18.504562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls podName:37f987fd-7ea2-47f5-a53f-620dfc939fba nodeName:}" failed. No retries permitted until 2026-07-05 19:31:19.004542359 +0000 UTC m=+77.631730802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-h25qk" (UID: "37f987fd-7ea2-47f5-a53f-620dfc939fba") : secret "prometheus-operator-tls" not found Jul 05 19:31:18.504820 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.504776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f987fd-7ea2-47f5-a53f-620dfc939fba-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.506390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.506369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:18.514351 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:18.514328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrng\" (UniqueName: \"kubernetes.io/projected/37f987fd-7ea2-47f5-a53f-620dfc939fba-kube-api-access-2jrng\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:19.007401 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.007335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:19.010447 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.010419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/37f987fd-7ea2-47f5-a53f-620dfc939fba-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h25qk\" (UID: \"37f987fd-7ea2-47f5-a53f-620dfc939fba\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:19.245018 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.244978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" Jul 05 19:31:19.273957 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.273880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" event={"ID":"d88bca6f-86d6-42ab-bc02-35081bbee6ab","Type":"ContainerStarted","Data":"f8804ed62f653cb3ffe479ee327078ee118d3b623079799722d69ed4394abfbe"} Jul 05 19:31:19.274200 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.274139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" event={"ID":"d88bca6f-86d6-42ab-bc02-35081bbee6ab","Type":"ContainerStarted","Data":"f2cccab9690de556d36c23c3bf8f9755d4f12173971b4549372f1775166139bf"} Jul 05 19:31:19.274328 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.274205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" event={"ID":"d88bca6f-86d6-42ab-bc02-35081bbee6ab","Type":"ContainerStarted","Data":"a9157afbcf6a9725bd21daaf27348d0c747e336606245dd0ab16947f40172c12"} Jul 05 19:31:19.275959 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.275848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drfcn" event={"ID":"af74b699-f048-4f84-a8f1-83b2ca4c2d3c","Type":"ContainerStarted","Data":"1a7b54de84d1d882363b6848e4648b6089b6df53b6390b196d9a12d6f5cc2c42"} Jul 05 19:31:19.292697 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.292645 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-576fbcc9f7-m2t7d" podStartSLOduration=3.842788628 podStartE2EDuration="8.292623038s" totalImagesPullingTime="4.44983441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:19.290896878 +0000 UTC m=+77.918085329" watchObservedRunningTime="2026-07-05 19:31:19.292623038 +0000 UTC m=+77.919811492" Jul 05 19:31:19.405334 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:19.405286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk"] Jul 05 19:31:19.408816 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:19.408790 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f987fd_7ea2_47f5_a53f_620dfc939fba.slice/crio-8a768ac3c376d82fdfce743852d13521aeced1aacb6da5a88babc35910cc1c7a WatchSource:0}: Error finding container 8a768ac3c376d82fdfce743852d13521aeced1aacb6da5a88babc35910cc1c7a: Status 404 returned error can't find the container with id 8a768ac3c376d82fdfce743852d13521aeced1aacb6da5a88babc35910cc1c7a Jul 05 19:31:20.281573 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:20.281528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" event={"ID":"37f987fd-7ea2-47f5-a53f-620dfc939fba","Type":"ContainerStarted","Data":"8a768ac3c376d82fdfce743852d13521aeced1aacb6da5a88babc35910cc1c7a"} Jul 05 19:31:23.295515 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:23.295472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drfcn" event={"ID":"af74b699-f048-4f84-a8f1-83b2ca4c2d3c","Type":"ContainerStarted","Data":"be914e8d3e803cb78155241f24c51a27bd82c0b1537493401cfd8d9c4f92e081"} Jul 05 19:31:23.297375 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:23.295585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drfcn" event={"ID":"af74b699-f048-4f84-a8f1-83b2ca4c2d3c","Type":"ContainerStarted","Data":"695d61849e425ae67efe3a87092fd251a6ee7dc83d17454809a81de2f65c487f"} Jul 05 19:31:23.298264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:23.298241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" event={"ID":"37f987fd-7ea2-47f5-a53f-620dfc939fba","Type":"ContainerStarted","Data":"25950d2176867b86c4001513b01762042344bb3e581b4e4e67b35e9f41713f72"} Jul 05 19:31:23.298327 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:23.298283 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" event={"ID":"37f987fd-7ea2-47f5-a53f-620dfc939fba","Type":"ContainerStarted","Data":"ab0084f37367900c1ed6ab1faf52dd2f88b7845317d0d3bc62c2d6e9634de8cb"} Jul 05 19:31:23.314779 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:23.314736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h25qk" podStartSLOduration=2.267769564 podStartE2EDuration="5.314722398s" totalImagesPullingTime="3.046952834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:23.313452415 +0000 UTC m=+81.940640866" watchObservedRunningTime="2026-07-05 19:31:23.314722398 +0000 UTC m=+81.941910827" Jul 05 19:31:24.249365 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:24.249333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z4rgc" Jul 05 19:31:25.693989 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.693962 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8kvbx"] Jul 05 19:31:25.698118 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.698100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.700140 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.700115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 19:31:25.700264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.700115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dkh7n\"" Jul 05 19:31:25.700264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.700205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 19:31:25.700379 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.700286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 19:31:25.761956 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.761924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-wtmp\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.761958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-tls\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-metrics-client-ca\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2q7s\" (UniqueName: \"kubernetes.io/projected/93886758-6c52-46c1-9d96-55c2ff5b52de-kube-api-access-x2q7s\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-sys\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-textfile\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.762359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.762243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-root\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863647 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-tls\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-metrics-client-ca\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2q7s\" (UniqueName: \"kubernetes.io/projected/93886758-6c52-46c1-9d96-55c2ff5b52de-kube-api-access-x2q7s\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-sys\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-textfile\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-root\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-wtmp\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.863852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.863821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864288 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-root\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864288 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864172 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-sys\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864288 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-wtmp\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864421 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-metrics-client-ca\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-textfile\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.864840 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.864822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.866218 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.866203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-tls\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.866483 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.866462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93886758-6c52-46c1-9d96-55c2ff5b52de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:25.872029 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:25.871995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2q7s\" (UniqueName: \"kubernetes.io/projected/93886758-6c52-46c1-9d96-55c2ff5b52de-kube-api-access-x2q7s\") pod \"node-exporter-8kvbx\" (UID: \"93886758-6c52-46c1-9d96-55c2ff5b52de\") " pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:26.018597 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:26.018486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kvbx" Jul 05 19:31:26.033225 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:31:26.033199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93886758_6c52_46c1_9d96_55c2ff5b52de.slice/crio-67a05c6db37cb9956c3d30e0fbdec14b5cf6c5e2b1e4ee4a35978f857c23dc8c WatchSource:0}: Error finding container 67a05c6db37cb9956c3d30e0fbdec14b5cf6c5e2b1e4ee4a35978f857c23dc8c: Status 404 returned error can't find the container with id 67a05c6db37cb9956c3d30e0fbdec14b5cf6c5e2b1e4ee4a35978f857c23dc8c Jul 05 19:31:26.311723 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:26.311690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drfcn" event={"ID":"af74b699-f048-4f84-a8f1-83b2ca4c2d3c","Type":"ContainerStarted","Data":"7ab703edd7c5eacccea095a9314c69af76e8efd03d5a286142d8509b1f9e21c9"} Jul 05 19:31:26.312910 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:26.312890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kvbx" event={"ID":"93886758-6c52-46c1-9d96-55c2ff5b52de","Type":"ContainerStarted","Data":"67a05c6db37cb9956c3d30e0fbdec14b5cf6c5e2b1e4ee4a35978f857c23dc8c"} Jul 05 19:31:26.332767 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:26.332673 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-drfcn" podStartSLOduration=33.198946901 podStartE2EDuration="40.332652672s" totalImagesPullingTime="7.133705771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:30:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:26.330662175 +0000 UTC m=+84.957850627" watchObservedRunningTime="2026-07-05 19:31:26.332652672 +0000 UTC m=+84.959841124" Jul 05 19:31:27.318544 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:27.318505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kvbx" event={"ID":"93886758-6c52-46c1-9d96-55c2ff5b52de","Type":"ContainerStarted","Data":"e78b88ca0e0da4e5be158d67861bfb8017de4fa1dd5d4d7225b378b04fa4c03d"} Jul 05 19:31:28.323372 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:28.323336 2576 generic.go:356] "Generic (PLEG): container finished" podID="93886758-6c52-46c1-9d96-55c2ff5b52de" containerID="e78b88ca0e0da4e5be158d67861bfb8017de4fa1dd5d4d7225b378b04fa4c03d" exitCode=0 Jul 05 19:31:28.323750 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:28.323381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kvbx" event={"ID":"93886758-6c52-46c1-9d96-55c2ff5b52de","Type":"ContainerDied","Data":"e78b88ca0e0da4e5be158d67861bfb8017de4fa1dd5d4d7225b378b04fa4c03d"} Jul 05 19:31:29.329021 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:29.328989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kvbx" event={"ID":"93886758-6c52-46c1-9d96-55c2ff5b52de","Type":"ContainerStarted","Data":"b21a7f5b252e3e8b5639960d2f81fb6e0b995d45621bbb593e309b9f39f4c855"} Jul 05 19:31:29.329661 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:29.329621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kvbx" event={"ID":"93886758-6c52-46c1-9d96-55c2ff5b52de","Type":"ContainerStarted","Data":"e806fee6dc841d6ed061de78babff1a6e4f4f6da223aeee7537975ef231732b3"} Jul 05 19:31:29.348473 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:29.348429 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8kvbx" podStartSLOduration=3.090369767 podStartE2EDuration="4.348415408s" totalImagesPullingTime="1.169771867s" totalInitContainerRuntime="88.273774ms" isStatefulPod=true podCreationTimestamp="2026-07-05 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:31:29.347075802 +0000 UTC m=+87.974264254" watchObservedRunningTime="2026-07-05 19:31:29.348415408 +0000 UTC m=+87.975603909" Jul 05 19:31:45.249235 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:31:45.249200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h5b5p" Jul 05 19:35:01.792442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:01.792417 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 19:35:32.622735 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.622697 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj"] Jul 05 19:35:32.626015 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.625999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.630119 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.630102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-txjr4\"" Jul 05 19:35:32.630119 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.630110 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 19:35:32.630752 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.630735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 19:35:32.647646 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.647612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj"] Jul 05 19:35:32.690529 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.690502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.690694 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.690550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.690694 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.690570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvrxt\" (UniqueName: \"kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.790950 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.790911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvrxt\" (UniqueName: \"kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.791108 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.790980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.791108 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.791038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.791400 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.791382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.791436 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.791426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.799651 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.799616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvrxt\" (UniqueName: \"kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:32.934996 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:32.934905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:33.065620 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:33.065567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj"] Jul 05 19:35:33.068699 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:35:33.068670 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a97635_e265_4bd4_831b_d82bc9d1fec1.slice/crio-297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3 WatchSource:0}: Error finding container 297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3: Status 404 returned error can't find the container with id 297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3 Jul 05 19:35:33.070658 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:33.070640 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:35:33.128191 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:33.128159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" event={"ID":"b4a97635-e265-4bd4-831b-d82bc9d1fec1","Type":"ContainerStarted","Data":"297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3"} Jul 05 19:35:39.152292 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.152201 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerID="22241d3d102639eb8a30afe1d23a044a1a6fad68e3b94c910f199c7f58adf42a" exitCode=0 Jul 05 19:35:39.152700 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.152290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" event={"ID":"b4a97635-e265-4bd4-831b-d82bc9d1fec1","Type":"ContainerDied","Data":"22241d3d102639eb8a30afe1d23a044a1a6fad68e3b94c910f199c7f58adf42a"} Jul 05 19:35:39.177490 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.177467 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dqq7l"] Jul 05 19:35:39.180400 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.180385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.182667 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.182646 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 19:35:39.182787 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.182745 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-45gkz\"" Jul 05 19:35:39.183337 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.183321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 19:35:39.189369 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.189343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dqq7l"] Jul 05 19:35:39.235210 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.235187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xdl6\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-kube-api-access-5xdl6\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.235341 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.235237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.336550 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.336523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xdl6\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-kube-api-access-5xdl6\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.336550 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.336557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.344368 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.344340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.344510 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.344493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xdl6\" (UniqueName: \"kubernetes.io/projected/a49eecc3-5301-4114-ab73-5fda693c7e1a-kube-api-access-5xdl6\") pod \"cert-manager-webhook-6486ffd997-dqq7l\" (UID: \"a49eecc3-5301-4114-ab73-5fda693c7e1a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.488954 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.488851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:39.621356 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:39.621322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dqq7l"] Jul 05 19:35:39.624442 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:35:39.624416 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49eecc3_5301_4114_ab73_5fda693c7e1a.slice/crio-3317ba14b5cdb9bd492f0f57dbb6702ddfcee52c0aeb55792ccc3a3b309102be WatchSource:0}: Error finding container 3317ba14b5cdb9bd492f0f57dbb6702ddfcee52c0aeb55792ccc3a3b309102be: Status 404 returned error can't find the container with id 3317ba14b5cdb9bd492f0f57dbb6702ddfcee52c0aeb55792ccc3a3b309102be Jul 05 19:35:40.158331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:40.158296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" event={"ID":"a49eecc3-5301-4114-ab73-5fda693c7e1a","Type":"ContainerStarted","Data":"3317ba14b5cdb9bd492f0f57dbb6702ddfcee52c0aeb55792ccc3a3b309102be"} Jul 05 19:35:44.179520 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:44.179484 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerID="377f053e937ab6ffde41ae29f4dfb627bf59f722f71e1a325fcca14add8c7f29" exitCode=0 Jul 05 19:35:44.179982 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:44.179573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" event={"ID":"b4a97635-e265-4bd4-831b-d82bc9d1fec1","Type":"ContainerDied","Data":"377f053e937ab6ffde41ae29f4dfb627bf59f722f71e1a325fcca14add8c7f29"} Jul 05 19:35:44.181137 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:44.181118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" event={"ID":"a49eecc3-5301-4114-ab73-5fda693c7e1a","Type":"ContainerStarted","Data":"6b43aeb9791c720e56134eb95f5aec79bf654efbb4648681fed85a2169935a0b"} Jul 05 19:35:44.181314 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:44.181301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:44.236576 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:44.236515 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" podStartSLOduration=1.598912943 podStartE2EDuration="5.236496734s" totalImagesPullingTime="3.637583791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:44.235752703 +0000 UTC m=+342.862941153" watchObservedRunningTime="2026-07-05 19:35:44.236496734 +0000 UTC m=+342.863685185" Jul 05 19:35:50.187693 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:50.187661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dqq7l" Jul 05 19:35:51.207932 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:51.207897 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerID="5ad3d7ad8a1ccc376b90eec63ef49f743a8cbb8dbc26dbc4bb05ea83b7cf7082" exitCode=0 Jul 05 19:35:51.208314 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:51.207982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" event={"ID":"b4a97635-e265-4bd4-831b-d82bc9d1fec1","Type":"ContainerDied","Data":"5ad3d7ad8a1ccc376b90eec63ef49f743a8cbb8dbc26dbc4bb05ea83b7cf7082"} Jul 05 19:35:52.337305 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.337282 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:52.423792 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.423762 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle\") pod \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " Jul 05 19:35:52.423943 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.423821 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util\") pod \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " Jul 05 19:35:52.423943 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.423841 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvrxt\" (UniqueName: \"kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt\") pod \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\" (UID: \"b4a97635-e265-4bd4-831b-d82bc9d1fec1\") " Jul 05 19:35:52.424168 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.424114 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle" (OuterVolumeSpecName: "bundle") pod "b4a97635-e265-4bd4-831b-d82bc9d1fec1" (UID: "b4a97635-e265-4bd4-831b-d82bc9d1fec1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:35:52.426158 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.426120 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt" (OuterVolumeSpecName: "kube-api-access-tvrxt") pod "b4a97635-e265-4bd4-831b-d82bc9d1fec1" (UID: "b4a97635-e265-4bd4-831b-d82bc9d1fec1"). InnerVolumeSpecName "kube-api-access-tvrxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:35:52.427880 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.427860 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util" (OuterVolumeSpecName: "util") pod "b4a97635-e265-4bd4-831b-d82bc9d1fec1" (UID: "b4a97635-e265-4bd4-831b-d82bc9d1fec1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:35:52.525065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.524989 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-util\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:35:52.525065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.525014 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvrxt\" (UniqueName: \"kubernetes.io/projected/b4a97635-e265-4bd4-831b-d82bc9d1fec1-kube-api-access-tvrxt\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:35:52.525065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:52.525023 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4a97635-e265-4bd4-831b-d82bc9d1fec1-bundle\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:35:53.216084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:53.216048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" event={"ID":"b4a97635-e265-4bd4-831b-d82bc9d1fec1","Type":"ContainerDied","Data":"297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3"} Jul 05 19:35:53.216084 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:53.216093 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="297f8b539b26394e950e79202f7b501325202e98689f77ba1e7904a95405d0c3" Jul 05 19:35:53.216352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:53.216106 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8fxbj" Jul 05 19:35:55.817830 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.817793 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f"] Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818021 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="pull" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818032 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="pull" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818039 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="extract" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818045 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="extract" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818058 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="util" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818063 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="util" Jul 05 19:35:55.818251 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.818105 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a97635-e265-4bd4-831b-d82bc9d1fec1" containerName="extract" Jul 05 19:35:55.820854 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.820838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.822869 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.822843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 19:35:55.823408 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.823391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 19:35:55.823520 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.823397 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5n7sq\"" Jul 05 19:35:55.832140 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.832117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f"] Jul 05 19:35:55.849992 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.849972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.850087 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.850009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbn7\" (UniqueName: \"kubernetes.io/projected/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-kube-api-access-chbn7\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.951122 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.951098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.951327 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.951303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbn7\" (UniqueName: \"kubernetes.io/projected/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-kube-api-access-chbn7\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.951495 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.951476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:55.959112 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:55.959085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbn7\" (UniqueName: \"kubernetes.io/projected/7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2-kube-api-access-chbn7\") pod \"openshift-lws-operator-fd8ccff4c-bms2f\" (UID: \"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:56.129283 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:56.129189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" Jul 05 19:35:56.254484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:56.254366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f"] Jul 05 19:35:56.256994 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:35:56.256963 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b0d32a3_f487_4a88_bf3d_e22c7a2a3cd2.slice/crio-e669c3958b4ec9f7b5a0b1deee57d23464786407aa7fe42d64ad226226262844 WatchSource:0}: Error finding container e669c3958b4ec9f7b5a0b1deee57d23464786407aa7fe42d64ad226226262844: Status 404 returned error can't find the container with id e669c3958b4ec9f7b5a0b1deee57d23464786407aa7fe42d64ad226226262844 Jul 05 19:35:57.232613 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:57.232576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" event={"ID":"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2","Type":"ContainerStarted","Data":"e669c3958b4ec9f7b5a0b1deee57d23464786407aa7fe42d64ad226226262844"} Jul 05 19:35:58.242829 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:58.242745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" event={"ID":"7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2","Type":"ContainerStarted","Data":"0babd717bc2590ad15502aca19559739b314bce8e971c72eba6212ec8d76c74f"} Jul 05 19:35:58.258484 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:35:58.258440 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bms2f" podStartSLOduration=1.607290142 podStartE2EDuration="3.258428146s" totalImagesPullingTime="1.651138004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:58.257622271 +0000 UTC m=+356.884810720" watchObservedRunningTime="2026-07-05 19:35:58.258428146 +0000 UTC m=+356.885616599" Jul 05 19:36:15.425204 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.425175 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2"] Jul 05 19:36:15.432396 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.432378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.434619 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.434591 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 05 19:36:15.434735 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.434704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2"] Jul 05 19:36:15.435230 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.435207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 05 19:36:15.435343 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.435252 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 05 19:36:15.435343 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.435275 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k6bnp\"" Jul 05 19:36:15.489887 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.489851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-metrics-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.490046 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.489895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-manager-config\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.490046 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.489921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.490046 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.489953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7f9\" (UniqueName: \"kubernetes.io/projected/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-kube-api-access-9f7f9\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.590889 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.590860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.591047 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.590902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7f9\" (UniqueName: \"kubernetes.io/projected/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-kube-api-access-9f7f9\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.591047 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.590945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-metrics-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.591047 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.590974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-manager-config\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.591658 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.591636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-manager-config\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.593422 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.593392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.593517 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.593454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-metrics-cert\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.601244 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.601222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7f9\" (UniqueName: \"kubernetes.io/projected/3032558a-ce61-45c0-bfdb-5ad2a543d3fc-kube-api-access-9f7f9\") pod \"lws-controller-manager-db9cc5d86-d4xt2\" (UID: \"3032558a-ce61-45c0-bfdb-5ad2a543d3fc\") " pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.742329 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.742249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:15.875179 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:15.875128 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2"] Jul 05 19:36:15.878063 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:36:15.878034 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3032558a_ce61_45c0_bfdb_5ad2a543d3fc.slice/crio-0f80664bc6808cd0022bf16ab9fe91f314bcb5fb32d35e5e8eb56a5ed42320c0 WatchSource:0}: Error finding container 0f80664bc6808cd0022bf16ab9fe91f314bcb5fb32d35e5e8eb56a5ed42320c0: Status 404 returned error can't find the container with id 0f80664bc6808cd0022bf16ab9fe91f314bcb5fb32d35e5e8eb56a5ed42320c0 Jul 05 19:36:16.047529 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.047438 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5"] Jul 05 19:36:16.051677 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.051653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.055382 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.055353 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 19:36:16.055617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.055594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 19:36:16.055676 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.055628 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 19:36:16.055676 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.055640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 19:36:16.055851 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.055836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k85hm\"" Jul 05 19:36:16.087371 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.087348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5"] Jul 05 19:36:16.094920 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.094894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.095035 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.094952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-manifests\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.095035 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.095016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-tmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.095171 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.095057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.095171 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.095094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jmp\" (UniqueName: \"kubernetes.io/projected/5a8c0887-e702-48be-981c-7d7f17aeb0e1-kube-api-access-75jmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196453 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-manifests\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196635 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-tmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196635 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196635 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jmp\" (UniqueName: \"kubernetes.io/projected/5a8c0887-e702-48be-981c-7d7f17aeb0e1-kube-api-access-75jmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196635 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.196905 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.196871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-manifests\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.198886 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.198866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a8c0887-e702-48be-981c-7d7f17aeb0e1-tmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.199094 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.199077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.199133 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.199110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a8c0887-e702-48be-981c-7d7f17aeb0e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.204299 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.204275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jmp\" (UniqueName: \"kubernetes.io/projected/5a8c0887-e702-48be-981c-7d7f17aeb0e1-kube-api-access-75jmp\") pod \"opendatahub-operator-controller-manager-68674bcb-6qhf5\" (UID: \"5a8c0887-e702-48be-981c-7d7f17aeb0e1\") " pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.306756 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.306684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" event={"ID":"3032558a-ce61-45c0-bfdb-5ad2a543d3fc","Type":"ContainerStarted","Data":"0f80664bc6808cd0022bf16ab9fe91f314bcb5fb32d35e5e8eb56a5ed42320c0"} Jul 05 19:36:16.361970 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.361943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:16.496320 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:16.496278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5"] Jul 05 19:36:16.499219 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:36:16.499193 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8c0887_e702_48be_981c_7d7f17aeb0e1.slice/crio-b21f7fb991f3d9b0cdf4e2c141642ff7ed30a8726717ce33067ddb9c12c2f7aa WatchSource:0}: Error finding container b21f7fb991f3d9b0cdf4e2c141642ff7ed30a8726717ce33067ddb9c12c2f7aa: Status 404 returned error can't find the container with id b21f7fb991f3d9b0cdf4e2c141642ff7ed30a8726717ce33067ddb9c12c2f7aa Jul 05 19:36:17.314721 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:17.314679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" event={"ID":"5a8c0887-e702-48be-981c-7d7f17aeb0e1","Type":"ContainerStarted","Data":"b21f7fb991f3d9b0cdf4e2c141642ff7ed30a8726717ce33067ddb9c12c2f7aa"} Jul 05 19:36:20.328413 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:20.328377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" event={"ID":"3032558a-ce61-45c0-bfdb-5ad2a543d3fc","Type":"ContainerStarted","Data":"ea8b645cbe63b821a94cd1b301bbb83b5482dfa0a75e8e6701aba947597a7f03"} Jul 05 19:36:20.328847 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:20.328428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:20.330055 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:20.330028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" event={"ID":"5a8c0887-e702-48be-981c-7d7f17aeb0e1","Type":"ContainerStarted","Data":"ff085cd17fe70b5967098818905c3be3f1d2d402efbad18f4c55155af12ec5ef"} Jul 05 19:36:20.346536 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:20.346484 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" podStartSLOduration=1.48994804 podStartE2EDuration="5.346467183s" totalImagesPullingTime="3.856519143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:36:20.345846744 +0000 UTC m=+378.973035194" watchObservedRunningTime="2026-07-05 19:36:20.346467183 +0000 UTC m=+378.973655632" Jul 05 19:36:21.335897 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:21.335864 2576 generic.go:356] "Generic (PLEG): container finished" podID="5a8c0887-e702-48be-981c-7d7f17aeb0e1" containerID="ff085cd17fe70b5967098818905c3be3f1d2d402efbad18f4c55155af12ec5ef" exitCode=0 Jul 05 19:36:21.336377 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:21.335954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" event={"ID":"5a8c0887-e702-48be-981c-7d7f17aeb0e1","Type":"ContainerDied","Data":"ff085cd17fe70b5967098818905c3be3f1d2d402efbad18f4c55155af12ec5ef"} Jul 05 19:36:22.341424 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:22.341387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" event={"ID":"5a8c0887-e702-48be-981c-7d7f17aeb0e1","Type":"ContainerStarted","Data":"c11f5ee3aa6bf8c4992fd009d3e4cf0fcf133314287c992de71a23f404d8aac7"} Jul 05 19:36:22.341859 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:22.341522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:22.363818 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:22.363766 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" podStartSLOduration=2.488488901 podStartE2EDuration="7.363751843s" totalImagesPullingTime="3.799993412s" totalInitContainerRuntime="1.07526953s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:36:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:36:22.36275884 +0000 UTC m=+380.989947289" watchObservedRunningTime="2026-07-05 19:36:22.363751843 +0000 UTC m=+380.990940292" Jul 05 19:36:31.338023 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:31.337989 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-db9cc5d86-d4xt2" Jul 05 19:36:33.347286 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:33.347259 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68674bcb-6qhf5" Jul 05 19:36:49.924651 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.924619 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf"] Jul 05 19:36:49.933719 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.933698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:49.937092 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.937068 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 19:36:49.937265 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.937242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 19:36:49.937372 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.937287 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vlq56\"" Jul 05 19:36:49.937372 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.937364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 19:36:49.951497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:49.951470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf"] Jul 05 19:36:50.043124 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043124 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043358 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043358 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043358 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043358 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043358 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043505 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskg9\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-kube-api-access-cskg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.043505 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.043432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144459 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskg9\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-kube-api-access-cskg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144818 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144818 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144818 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.144818 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145033 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.144822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145088 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.145048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145279 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.145254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145410 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.145384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145487 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.145436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.145791 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.145767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.147559 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.147535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.147649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.147567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.154951 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.154927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.155044 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.154994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskg9\" (UniqueName: \"kubernetes.io/projected/b8fd4f69-fd56-4e8b-b61e-5c0816874317-kube-api-access-cskg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678v97tf\" (UID: \"b8fd4f69-fd56-4e8b-b61e-5c0816874317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.248029 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.247946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:50.435124 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.435089 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz"] Jul 05 19:36:50.447843 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:36:50.447814 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fd4f69_fd56_4e8b_b61e_5c0816874317.slice/crio-43819e441b245e3d4d1e573702f1942b87ed93d7c4805c3ee93f5db0907947a6 WatchSource:0}: Error finding container 43819e441b245e3d4d1e573702f1942b87ed93d7c4805c3ee93f5db0907947a6: Status 404 returned error can't find the container with id 43819e441b245e3d4d1e573702f1942b87ed93d7c4805c3ee93f5db0907947a6 Jul 05 19:36:50.452961 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.452940 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf"] Jul 05 19:36:50.453042 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.453035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.455737 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.455720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8nc8c\"" Jul 05 19:36:50.456124 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.456108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 19:36:50.456319 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.456308 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 19:36:50.456363 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.456316 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 19:36:50.464271 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.464248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz"] Jul 05 19:36:50.548382 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548382 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwhl\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-kube-api-access-sfwhl\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a75cee0-2ca4-4fca-8086-732e5469454c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.548596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.548567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649428 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649428 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwhl\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-kube-api-access-sfwhl\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a75cee0-2ca4-4fca-8086-732e5469454c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.649692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.649676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.650668 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.650632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.651924 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.651902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a75cee0-2ca4-4fca-8086-732e5469454c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.652047 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.652031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.652117 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.652072 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.652233 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.652215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a75cee0-2ca4-4fca-8086-732e5469454c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.657905 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.657885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwhl\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-kube-api-access-sfwhl\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.658094 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.658078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a75cee0-2ca4-4fca-8086-732e5469454c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7j7rz\" (UID: \"0a75cee0-2ca4-4fca-8086-732e5469454c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.762565 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.762525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:50.922959 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:50.922931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz"] Jul 05 19:36:50.925448 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:36:50.925426 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a75cee0_2ca4_4fca_8086_732e5469454c.slice/crio-bfa3a276b93247cb1cce5ec79a7b3463ea3cc19e3280458d2d7d3085c3da0dc5 WatchSource:0}: Error finding container bfa3a276b93247cb1cce5ec79a7b3463ea3cc19e3280458d2d7d3085c3da0dc5: Status 404 returned error can't find the container with id bfa3a276b93247cb1cce5ec79a7b3463ea3cc19e3280458d2d7d3085c3da0dc5 Jul 05 19:36:51.454328 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:51.454288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" event={"ID":"b8fd4f69-fd56-4e8b-b61e-5c0816874317","Type":"ContainerStarted","Data":"43819e441b245e3d4d1e573702f1942b87ed93d7c4805c3ee93f5db0907947a6"} Jul 05 19:36:51.455587 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:51.455560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" event={"ID":"0a75cee0-2ca4-4fca-8086-732e5469454c","Type":"ContainerStarted","Data":"bfa3a276b93247cb1cce5ec79a7b3463ea3cc19e3280458d2d7d3085c3da0dc5"} Jul 05 19:36:53.750691 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:53.750652 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:36:53.750944 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:53.750736 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:36:53.750944 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:53.750767 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:36:54.469740 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:54.469702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" event={"ID":"b8fd4f69-fd56-4e8b-b61e-5c0816874317","Type":"ContainerStarted","Data":"73707bdb53dc63ba8fef04608ce8dad373561576ab5e0bfcf91f34c10a1586f5"} Jul 05 19:36:54.491465 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:54.491412 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" podStartSLOduration=2.19058042 podStartE2EDuration="5.491396427s" totalImagesPullingTime="3.300816007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:36:54.490216397 +0000 UTC m=+413.117404848" watchObservedRunningTime="2026-07-05 19:36:54.491396427 +0000 UTC m=+413.118584924" Jul 05 19:36:55.248213 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:55.248178 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:55.252900 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:55.252874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:55.474533 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:55.474505 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:55.475389 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:55.475370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678v97tf" Jul 05 19:36:57.149703 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:57.149668 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:36:57.149985 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:57.149731 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:36:57.485959 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:57.485851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" event={"ID":"0a75cee0-2ca4-4fca-8086-732e5469454c","Type":"ContainerStarted","Data":"5cd7e0e6ea3595ad7d741ce47a65574b471c276add1b1fb91f559b77573b2b4d"} Jul 05 19:36:57.485959 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:57.485928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:36:57.508326 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:57.508267 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" podStartSLOduration=1.286211307 podStartE2EDuration="7.508245113s" totalImagesPullingTime="6.222033806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:36:57.507391801 +0000 UTC m=+416.134580262" watchObservedRunningTime="2026-07-05 19:36:57.508245113 +0000 UTC m=+416.135433565" Jul 05 19:36:58.491282 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:36:58.491251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7j7rz" Jul 05 19:39:15.955403 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:15.955373 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q"] Jul 05 19:39:15.958560 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:15.958543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:15.960794 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:15.960773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tcmd8\"" Jul 05 19:39:15.969828 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:15.969804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q"] Jul 05 19:39:16.025344 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025344 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13326e1-71de-41d4-b8a4-628c546081ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025598 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13326e1-71de-41d4-b8a4-628c546081ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025598 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025598 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025598 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025855 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025855 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.025855 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.025759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwhk\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-kube-api-access-wvwhk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126071 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126071 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwhk\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-kube-api-access-wvwhk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13326e1-71de-41d4-b8a4-628c546081ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13326e1-71de-41d4-b8a4-628c546081ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126348 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126868 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.126989 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.126957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.127189 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.127055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.127320 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.127240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.127410 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.127245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13326e1-71de-41d4-b8a4-628c546081ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.129488 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.129458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13326e1-71de-41d4-b8a4-628c546081ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.133918 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.133890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13326e1-71de-41d4-b8a4-628c546081ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.134378 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.134357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.135131 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.135107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwhk\" (UniqueName: \"kubernetes.io/projected/f13326e1-71de-41d4-b8a4-628c546081ea-kube-api-access-wvwhk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6c57q\" (UID: \"f13326e1-71de-41d4-b8a4-628c546081ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.269669 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.269577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:16.402338 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.402302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q"] Jul 05 19:39:16.406386 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:39:16.406358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13326e1_71de_41d4_b8a4_628c546081ea.slice/crio-b5b3d04db51cbdc927dec493d474d7adb91cd4c66cf8c0a1cdbdb00e7534f59b WatchSource:0}: Error finding container b5b3d04db51cbdc927dec493d474d7adb91cd4c66cf8c0a1cdbdb00e7534f59b: Status 404 returned error can't find the container with id b5b3d04db51cbdc927dec493d474d7adb91cd4c66cf8c0a1cdbdb00e7534f59b Jul 05 19:39:16.408442 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.408411 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:39:16.408522 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.408482 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:39:16.408522 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:16.408511 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:39:17.051868 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:17.051834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" event={"ID":"f13326e1-71de-41d4-b8a4-628c546081ea","Type":"ContainerStarted","Data":"59b450126c3dc29fe9b33fcca435b5fb181e45e3280f2c32749056ea5dadaa5f"} Jul 05 19:39:17.052276 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:17.051882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" event={"ID":"f13326e1-71de-41d4-b8a4-628c546081ea","Type":"ContainerStarted","Data":"b5b3d04db51cbdc927dec493d474d7adb91cd4c66cf8c0a1cdbdb00e7534f59b"} Jul 05 19:39:17.071435 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:17.071367 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" podStartSLOduration=2.071350543 podStartE2EDuration="2.071350543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:39:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:17.069838003 +0000 UTC m=+555.697026450" watchObservedRunningTime="2026-07-05 19:39:17.071350543 +0000 UTC m=+555.698538995" Jul 05 19:39:17.270059 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:17.270024 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:17.274713 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:17.274687 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:18.056022 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:18.055994 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:39:18.056810 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:39:18.056793 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:40:44.402411 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.402379 2576 generic.go:356] "Generic (PLEG): container finished" podID="f13326e1-71de-41d4-b8a4-628c546081ea" containerID="59b450126c3dc29fe9b33fcca435b5fb181e45e3280f2c32749056ea5dadaa5f" exitCode=0 Jul 05 19:40:44.402852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.402419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" event={"ID":"f13326e1-71de-41d4-b8a4-628c546081ea","Type":"ContainerDied","Data":"59b450126c3dc29fe9b33fcca435b5fb181e45e3280f2c32749056ea5dadaa5f"} Jul 05 19:40:44.402852 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.402760 2576 scope.go:117] "RemoveContainer" containerID="59b450126c3dc29fe9b33fcca435b5fb181e45e3280f2c32749056ea5dadaa5f" Jul 05 19:40:44.403736 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.403705 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:40:44.403817 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.403780 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:40:44.403817 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:44.403813 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:40:45.408359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:45.408322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" event={"ID":"f13326e1-71de-41d4-b8a4-628c546081ea","Type":"ContainerStarted","Data":"2e7c0ef0af3ff8459eb8448db269f90222c905a524ea7c6fbeee9f76a2266654"} Jul 05 19:40:46.270317 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:46.270283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:40:46.271414 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:46.271392 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6c57q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 05 19:40:46.271513 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:46.271440 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" podUID="f13326e1-71de-41d4-b8a4-628c546081ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 05 19:40:47.270567 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:47.270534 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6c57q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 05 19:40:47.270945 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:47.270597 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" podUID="f13326e1-71de-41d4-b8a4-628c546081ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 05 19:40:48.056616 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:48.056564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:40:48.270018 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:48.269984 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6c57q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 05 19:40:48.270208 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:48.270038 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" podUID="f13326e1-71de-41d4-b8a4-628c546081ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 05 19:40:49.270816 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:49.270777 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6c57q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 05 19:40:49.271239 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:49.270831 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" podUID="f13326e1-71de-41d4-b8a4-628c546081ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 05 19:40:50.273844 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:50.273817 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:40:50.274661 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:50.274643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6c57q" Jul 05 19:40:59.134179 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.134125 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl"] Jul 05 19:40:59.137412 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.137392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.139596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.139570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 05 19:40:59.140178 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.140158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 05 19:40:59.140178 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.140171 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 05 19:40:59.140330 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.140238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cxv76\"" Jul 05 19:40:59.147232 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.147210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl"] Jul 05 19:40:59.170159 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.170159 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.170352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.170352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.170352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrlbt\" (UniqueName: \"kubernetes.io/projected/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-kube-api-access-lrlbt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.170352 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.170327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271373 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271373 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrlbt\" (UniqueName: \"kubernetes.io/projected/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-kube-api-access-lrlbt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271844 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271903 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.271950 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.271908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.273707 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.273691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.274020 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.274003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.278388 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.278367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrlbt\" (UniqueName: \"kubernetes.io/projected/ee5e2cc3-3c38-4bd1-be18-bee5936bf977-kube-api-access-lrlbt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v8chl\" (UID: \"ee5e2cc3-3c38-4bd1-be18-bee5936bf977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.448524 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.448440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:40:59.572069 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.572045 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl"] Jul 05 19:40:59.574332 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:40:59.574309 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5e2cc3_3c38_4bd1_be18_bee5936bf977.slice/crio-9b8460e4e4a67116576e232c7992d3987592a0cbf938c0792c1aa468f9609c26 WatchSource:0}: Error finding container 9b8460e4e4a67116576e232c7992d3987592a0cbf938c0792c1aa468f9609c26: Status 404 returned error can't find the container with id 9b8460e4e4a67116576e232c7992d3987592a0cbf938c0792c1aa468f9609c26 Jul 05 19:40:59.575624 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:40:59.575608 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 19:41:00.472361 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:00.472326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" event={"ID":"ee5e2cc3-3c38-4bd1-be18-bee5936bf977","Type":"ContainerStarted","Data":"9b8460e4e4a67116576e232c7992d3987592a0cbf938c0792c1aa468f9609c26"} Jul 05 19:41:01.484693 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:01.484660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" event={"ID":"ee5e2cc3-3c38-4bd1-be18-bee5936bf977","Type":"ContainerStarted","Data":"cfe0c169cde585653c0c54679b34f8004c2340f320dd2aabdfe147aa3801551a"} Jul 05 19:41:01.500923 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:01.500882 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" podStartSLOduration=1.5277570950000001 podStartE2EDuration="2.500867504s" totalImagesPullingTime="973.110409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:01.498699792 +0000 UTC m=+660.125888243" watchObservedRunningTime="2026-07-05 19:41:01.500867504 +0000 UTC m=+660.128055953" Jul 05 19:41:09.449036 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:09.448992 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:41:09.449563 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:09.449057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:41:09.461319 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:09.461293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:41:09.534698 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:09.534664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v8chl" Jul 05 19:41:28.846509 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.846464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2"] Jul 05 19:41:28.849819 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.849793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.851920 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.851900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 05 19:41:28.859226 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.859202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2"] Jul 05 19:41:28.916020 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.915987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.916235 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.916038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.916235 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.916086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw664\" (UniqueName: \"kubernetes.io/projected/2f08fc15-0008-4fbe-a2e3-3d37588a6785-kube-api-access-sw664\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.916235 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.916208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.916418 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.916241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:28.916418 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:28.916272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017568 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017742 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw664\" (UniqueName: \"kubernetes.io/projected/2f08fc15-0008-4fbe-a2e3-3d37588a6785-kube-api-access-sw664\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017988 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.017988 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.017915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.018132 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.018109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.020127 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.020105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f08fc15-0008-4fbe-a2e3-3d37588a6785-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.020417 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.020395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f08fc15-0008-4fbe-a2e3-3d37588a6785-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.025583 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.025559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw664\" (UniqueName: \"kubernetes.io/projected/2f08fc15-0008-4fbe-a2e3-3d37588a6785-kube-api-access-sw664\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xgdf2\" (UID: \"2f08fc15-0008-4fbe-a2e3-3d37588a6785\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.160896 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.160800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:29.300928 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.300745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2"] Jul 05 19:41:29.303580 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:41:29.303547 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f08fc15_0008_4fbe_a2e3_3d37588a6785.slice/crio-aca21ad49e440c2016d1b3cd3c8e083c9fb0bab96f996ceff2775972d53c241b WatchSource:0}: Error finding container aca21ad49e440c2016d1b3cd3c8e083c9fb0bab96f996ceff2775972d53c241b: Status 404 returned error can't find the container with id aca21ad49e440c2016d1b3cd3c8e083c9fb0bab96f996ceff2775972d53c241b Jul 05 19:41:29.606064 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.606025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" event={"ID":"2f08fc15-0008-4fbe-a2e3-3d37588a6785","Type":"ContainerStarted","Data":"802e2b3fac964f3e304238ab4bb95ebcb25634c7eadf69ddcb7120822df4d11e"} Jul 05 19:41:29.606233 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.606080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" event={"ID":"2f08fc15-0008-4fbe-a2e3-3d37588a6785","Type":"ContainerStarted","Data":"aca21ad49e440c2016d1b3cd3c8e083c9fb0bab96f996ceff2775972d53c241b"} Jul 05 19:41:29.626000 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:29.625934 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" podStartSLOduration=1.466955901 podStartE2EDuration="1.625915215s" totalImagesPullingTime="158.959314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:41:29.623360387 +0000 UTC m=+688.250548838" watchObservedRunningTime="2026-07-05 19:41:29.625915215 +0000 UTC m=+688.253103670" Jul 05 19:41:39.160973 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:39.160927 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:39.161426 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:39.161007 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:39.174594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:39.174551 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:41:39.659493 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:41:39.659465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xgdf2" Jul 05 19:56:07.852822 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.852792 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:07.858584 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.858555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.861755 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.861725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5fe4b92a-openshift-default-dockercfg-zdj8w\"" Jul 05 19:56:07.875436 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.875409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:07.946297 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsgsd\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946468 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:07.946692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:07.946556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.047823 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.047777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.047823 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.047825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.047941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsgsd\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.047981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048070 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048505 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048575 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048664 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.048897 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.048880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.050388 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.050366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.050583 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.050561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.055444 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.055416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.055718 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.055698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsgsd\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd\") pod \"e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.169658 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.169573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:08.308548 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.308522 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:08.311121 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:56:08.311089 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff990be_432c_4c61_a002_0fa9919fc6c7.slice/crio-ac15b699b061560dd22bf0391cf08be1e314fea4a0c6bc513df30eb0f7e60630 WatchSource:0}: Error finding container ac15b699b061560dd22bf0391cf08be1e314fea4a0c6bc513df30eb0f7e60630: Status 404 returned error can't find the container with id ac15b699b061560dd22bf0391cf08be1e314fea4a0c6bc513df30eb0f7e60630 Jul 05 19:56:08.313229 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.313201 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:08.313299 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.313267 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:08.313336 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:08.313299 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:09.302096 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:09.302060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" event={"ID":"fff990be-432c-4c61-a002-0fa9919fc6c7","Type":"ContainerStarted","Data":"e3ba796a60ad6086b70813b9f603f75c79ad7e5008aeef082f8810cd6d59535c"} Jul 05 19:56:09.302613 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:09.302110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" event={"ID":"fff990be-432c-4c61-a002-0fa9919fc6c7","Type":"ContainerStarted","Data":"ac15b699b061560dd22bf0391cf08be1e314fea4a0c6bc513df30eb0f7e60630"} Jul 05 19:56:09.324749 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:09.324696 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" podStartSLOduration=2.324681071 podStartE2EDuration="2.324681071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:56:09.321844298 +0000 UTC m=+1567.949032752" watchObservedRunningTime="2026-07-05 19:56:09.324681071 +0000 UTC m=+1567.951869564" Jul 05 19:56:10.170677 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:10.170647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:10.175285 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:10.175262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:10.306504 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:10.306467 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:10.307363 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:10.307345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:14.215026 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:14.214988 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:14.215465 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:14.215213 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" podUID="fff990be-432c-4c61-a002-0fa9919fc6c7" containerName="istio-proxy" containerID="cri-o://e3ba796a60ad6086b70813b9f603f75c79ad7e5008aeef082f8810cd6d59535c" gracePeriod=30 Jul 05 19:56:19.345609 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.345574 2576 generic.go:356] "Generic (PLEG): container finished" podID="fff990be-432c-4c61-a002-0fa9919fc6c7" containerID="e3ba796a60ad6086b70813b9f603f75c79ad7e5008aeef082f8810cd6d59535c" exitCode=0 Jul 05 19:56:19.346031 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.345620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" event={"ID":"fff990be-432c-4c61-a002-0fa9919fc6c7","Type":"ContainerDied","Data":"e3ba796a60ad6086b70813b9f603f75c79ad7e5008aeef082f8810cd6d59535c"} Jul 05 19:56:19.469629 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.469605 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:19.651661 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.651841 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651674 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.651841 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651710 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.651841 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651758 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.651841 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651806 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651869 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsgsd\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651892 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651939 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert\") pod \"fff990be-432c-4c61-a002-0fa9919fc6c7\" (UID: \"fff990be-432c-4c61-a002-0fa9919fc6c7\") " Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651960 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:19.652051 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.651984 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:19.652374 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652165 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:19.652374 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652286 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.652374 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652304 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.652374 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652318 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.652738 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652376 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:19.652738 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.652570 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:56:19.654250 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.654220 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 19:56:19.654424 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.654401 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd" (OuterVolumeSpecName: "kube-api-access-nsgsd") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "kube-api-access-nsgsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:19.654497 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.654463 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:19.654628 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.654613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fff990be-432c-4c61-a002-0fa9919fc6c7" (UID: "fff990be-432c-4c61-a002-0fa9919fc6c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:19.752998 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.752963 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.752998 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.752993 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.752998 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.753005 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsgsd\" (UniqueName: \"kubernetes.io/projected/fff990be-432c-4c61-a002-0fa9919fc6c7-kube-api-access-nsgsd\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.753259 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.753018 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff990be-432c-4c61-a002-0fa9919fc6c7-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.753259 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.753030 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff990be-432c-4c61-a002-0fa9919fc6c7-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:19.753259 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:19.753042 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff990be-432c-4c61-a002-0fa9919fc6c7-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:20.253384 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.253312 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:20.253637 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.253623 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff990be-432c-4c61-a002-0fa9919fc6c7" containerName="istio-proxy" Jul 05 19:56:20.253677 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.253640 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff990be-432c-4c61-a002-0fa9919fc6c7" containerName="istio-proxy" Jul 05 19:56:20.253708 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.253701 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff990be-432c-4c61-a002-0fa9919fc6c7" containerName="istio-proxy" Jul 05 19:56:20.256870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.256841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.259069 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.259046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ebeca618-openshift-default-dockercfg-hnlqk\"" Jul 05 19:56:20.267366 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.267339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:20.351958 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.351910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" event={"ID":"fff990be-432c-4c61-a002-0fa9919fc6c7","Type":"ContainerDied","Data":"ac15b699b061560dd22bf0391cf08be1e314fea4a0c6bc513df30eb0f7e60630"} Jul 05 19:56:20.351958 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.351957 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls" Jul 05 19:56:20.352605 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.351988 2576 scope.go:117] "RemoveContainer" containerID="e3ba796a60ad6086b70813b9f603f75c79ad7e5008aeef082f8810cd6d59535c" Jul 05 19:56:20.358746 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358858 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhct7\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358858 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358858 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358980 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358980 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.358980 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.359086 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.358998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.359086 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.359024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.371268 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.371245 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:20.375114 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.375087 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5fe4b92a-openshift-default-7dbc4c6c9-2nhls"] Jul 05 19:56:20.460079 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhct7\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460264 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460500 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460500 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460500 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460662 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460662 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460763 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460843 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.460902 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.460886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.462564 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.462543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.462887 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.462864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.467662 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.467631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhct7\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.467750 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.467725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token\") pod \"e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.569350 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.569312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:20.704024 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.703995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:20.706579 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:56:20.706549 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9deb6085_a185_4593_aa34_d28806e5f134.slice/crio-ed0b935ee0744337fd092e3f6e41ba78a87c9ba6cc00d47a342cb1ad2e7f3091 WatchSource:0}: Error finding container ed0b935ee0744337fd092e3f6e41ba78a87c9ba6cc00d47a342cb1ad2e7f3091: Status 404 returned error can't find the container with id ed0b935ee0744337fd092e3f6e41ba78a87c9ba6cc00d47a342cb1ad2e7f3091 Jul 05 19:56:20.709228 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.709199 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:20.709293 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.709260 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:20.709293 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:20.709290 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:21.359206 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.359170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerStarted","Data":"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1"} Jul 05 19:56:21.359631 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.359219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerStarted","Data":"ed0b935ee0744337fd092e3f6e41ba78a87c9ba6cc00d47a342cb1ad2e7f3091"} Jul 05 19:56:21.377534 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.377436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" podStartSLOduration=1.377414815 podStartE2EDuration="1.377414815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:56:21.376487588 +0000 UTC m=+1580.003676040" watchObservedRunningTime="2026-07-05 19:56:21.377414815 +0000 UTC m=+1580.004603462" Jul 05 19:56:21.570035 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.569997 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:21.596732 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.596688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:21.913571 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:21.913538 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff990be-432c-4c61-a002-0fa9919fc6c7" path="/var/lib/kubelet/pods/fff990be-432c-4c61-a002-0fa9919fc6c7/volumes" Jul 05 19:56:22.363948 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:22.363909 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:22.365002 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:22.364978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:32.412587 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.412484 2576 generic.go:356] "Generic (PLEG): container finished" podID="9deb6085-a185-4593-aa34-d28806e5f134" containerID="c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1" exitCode=0 Jul 05 19:56:32.413065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.412582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerDied","Data":"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1"} Jul 05 19:56:32.413065 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.413051 2576 scope.go:117] "RemoveContainer" containerID="c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1" Jul 05 19:56:32.414080 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.414050 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:32.414211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.414121 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:32.414211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.414202 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:32.858371 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:32.858329 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:33.419738 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:33.419704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerStarted","Data":"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171"} Jul 05 19:56:33.420221 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:33.419768 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" containerID="cri-o://2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171" gracePeriod=30 Jul 05 19:56:37.364614 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:37.364579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:38.671722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.671693 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:38.713420 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713420 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713373 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713630 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713630 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713597 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713743 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhct7\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713743 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713743 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713707 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:38.713901 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713901 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713796 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713901 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert\") pod \"9deb6085-a185-4593-aa34-d28806e5f134\" (UID: \"9deb6085-a185-4593-aa34-d28806e5f134\") " Jul 05 19:56:38.713901 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713876 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:38.714254 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.713913 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:38.714254 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.714237 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.714401 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.714327 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.714455 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.714442 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.714455 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.714374 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:56:38.714982 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.714955 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data" (OuterVolumeSpecName: "istio-data") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:38.715830 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.715806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:38.715830 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.715817 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 19:56:38.715952 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.715823 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7" (OuterVolumeSpecName: "kube-api-access-fhct7") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "kube-api-access-fhct7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:38.716095 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.716074 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token" (OuterVolumeSpecName: "istio-token") pod "9deb6085-a185-4593-aa34-d28806e5f134" (UID: "9deb6085-a185-4593-aa34-d28806e5f134"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:38.815568 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815534 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhct7\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-kube-api-access-fhct7\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.815568 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815563 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9deb6085-a185-4593-aa34-d28806e5f134-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.815568 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815573 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.815865 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815580 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9deb6085-a185-4593-aa34-d28806e5f134-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.815865 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815588 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9deb6085-a185-4593-aa34-d28806e5f134-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.815865 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.815595 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9deb6085-a185-4593-aa34-d28806e5f134-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:38.863055 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863020 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:38.863537 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863516 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.863537 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863537 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.863722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863551 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.863722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863560 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.863722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863658 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.863722 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.863671 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9deb6085-a185-4593-aa34-d28806e5f134" containerName="istio-proxy" Jul 05 19:56:38.867174 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.867019 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.869353 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.869328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-da4a26de-openshift-default-dockercfg-lhcv2\"" Jul 05 19:56:38.876912 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.876687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:38.916249 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916383 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916383 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916383 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgmj9\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916383 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916383 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916549 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916549 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:38.916549 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:38.916487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.017938 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.017843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.017938 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.017897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.017938 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.017921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.017938 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.017945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgmj9\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.017984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018315 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018645 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018645 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018754 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.018754 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.018730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.021109 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.021075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.021232 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.021221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.025596 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.025575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.025717 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.025702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgmj9\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9\") pod \"e2e-derive-da4a26de-openshift-default-64c465d859-d94jf\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.181132 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.181102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:39.316395 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.316368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:39.318412 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:56:39.318389 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdbd105_6a69_48e2_9c45_1d8561e06cdb.slice/crio-1f56a51ad7034a80caf0bbb55d552a95616b8fca066d93025b0d154edfdd5935 WatchSource:0}: Error finding container 1f56a51ad7034a80caf0bbb55d552a95616b8fca066d93025b0d154edfdd5935: Status 404 returned error can't find the container with id 1f56a51ad7034a80caf0bbb55d552a95616b8fca066d93025b0d154edfdd5935 Jul 05 19:56:39.320398 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.320368 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:39.320451 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.320432 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:39.320495 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.320468 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:56:39.448214 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.448185 2576 generic.go:356] "Generic (PLEG): container finished" podID="9deb6085-a185-4593-aa34-d28806e5f134" containerID="2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171" exitCode=0 Jul 05 19:56:39.448390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.448245 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" Jul 05 19:56:39.448390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.448271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerDied","Data":"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171"} Jul 05 19:56:39.448390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.448319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn" event={"ID":"9deb6085-a185-4593-aa34-d28806e5f134","Type":"ContainerDied","Data":"ed0b935ee0744337fd092e3f6e41ba78a87c9ba6cc00d47a342cb1ad2e7f3091"} Jul 05 19:56:39.448390 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.448337 2576 scope.go:117] "RemoveContainer" containerID="2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171" Jul 05 19:56:39.450658 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.450573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" event={"ID":"ccdbd105-6a69-48e2-9c45-1d8561e06cdb","Type":"ContainerStarted","Data":"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0"} Jul 05 19:56:39.450658 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.450647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" event={"ID":"ccdbd105-6a69-48e2-9c45-1d8561e06cdb","Type":"ContainerStarted","Data":"1f56a51ad7034a80caf0bbb55d552a95616b8fca066d93025b0d154edfdd5935"} Jul 05 19:56:39.458967 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.458948 2576 scope.go:117] "RemoveContainer" containerID="c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1" Jul 05 19:56:39.467483 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.467461 2576 scope.go:117] "RemoveContainer" containerID="2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171" Jul 05 19:56:39.467783 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:56:39.467761 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171\": container with ID starting with 2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171 not found: ID does not exist" containerID="2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171" Jul 05 19:56:39.467875 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.467792 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171"} err="failed to get container status \"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171\": rpc error: code = NotFound desc = could not find container \"2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171\": container with ID starting with 2a1ba974081559c8155fc940fc92edeb966f224eb52c118fca224170ffe73171 not found: ID does not exist" Jul 05 19:56:39.467875 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.467824 2576 scope.go:117] "RemoveContainer" containerID="c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1" Jul 05 19:56:39.468128 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:56:39.468101 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1\": container with ID starting with c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1 not found: ID does not exist" containerID="c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1" Jul 05 19:56:39.468211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.468137 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1"} err="failed to get container status \"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1\": rpc error: code = NotFound desc = could not find container \"c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1\": container with ID starting with c95a06be323ca8a7c560a586781ff9a84090c72ef0c37083c4839dcdf847dbb1 not found: ID does not exist" Jul 05 19:56:39.469847 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.469807 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" podStartSLOduration=1.469793922 podStartE2EDuration="1.469793922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:56:39.468239365 +0000 UTC m=+1598.095427819" watchObservedRunningTime="2026-07-05 19:56:39.469793922 +0000 UTC m=+1598.096982402" Jul 05 19:56:39.484034 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.483958 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:39.486338 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.486314 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ebeca618-openshift-default-5dbb95555c-ktbbn"] Jul 05 19:56:39.912944 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:39.912914 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9deb6085-a185-4593-aa34-d28806e5f134" path="/var/lib/kubelet/pods/9deb6085-a185-4593-aa34-d28806e5f134/volumes" Jul 05 19:56:40.181579 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:40.181496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:40.186222 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:40.186196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:40.456733 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:40.456648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:40.457632 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:40.457603 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:44.671720 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:44.671671 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:44.672180 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:44.671864 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" podUID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" containerName="istio-proxy" containerID="cri-o://a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0" gracePeriod=30 Jul 05 19:56:50.828376 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.828345 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:50.933043 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.932956 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933043 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.932989 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933043 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933018 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933096 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933127 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgmj9\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933186 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933224 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933331 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933260 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy\") pod \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\" (UID: \"ccdbd105-6a69-48e2-9c45-1d8561e06cdb\") " Jul 05 19:56:50.933617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933357 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:50.933617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933423 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:56:50.933617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933485 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:50.933617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933530 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:50.933780 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933645 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:50.933780 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933665 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:50.933780 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933678 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:50.933780 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.933693 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:50.934211 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.934180 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:50.935609 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.935583 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:56:50.935711 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.935636 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9" (OuterVolumeSpecName: "kube-api-access-rgmj9") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "kube-api-access-rgmj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:50.935879 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.935858 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:56:50.935948 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:50.935854 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ccdbd105-6a69-48e2-9c45-1d8561e06cdb" (UID: "ccdbd105-6a69-48e2-9c45-1d8561e06cdb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 19:56:51.034475 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.034440 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:51.034475 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.034467 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:51.034475 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.034476 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgmj9\" (UniqueName: \"kubernetes.io/projected/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-kube-api-access-rgmj9\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:51.034692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.034486 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:51.034692 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.034495 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccdbd105-6a69-48e2-9c45-1d8561e06cdb-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:56:51.506182 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.506131 2576 generic.go:356] "Generic (PLEG): container finished" podID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" containerID="a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0" exitCode=0 Jul 05 19:56:51.506379 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.506197 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" Jul 05 19:56:51.506379 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.506211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" event={"ID":"ccdbd105-6a69-48e2-9c45-1d8561e06cdb","Type":"ContainerDied","Data":"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0"} Jul 05 19:56:51.506379 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.506264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf" event={"ID":"ccdbd105-6a69-48e2-9c45-1d8561e06cdb","Type":"ContainerDied","Data":"1f56a51ad7034a80caf0bbb55d552a95616b8fca066d93025b0d154edfdd5935"} Jul 05 19:56:51.507115 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.506290 2576 scope.go:117] "RemoveContainer" containerID="a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0" Jul 05 19:56:51.515826 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.515810 2576 scope.go:117] "RemoveContainer" containerID="a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0" Jul 05 19:56:51.516105 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:56:51.516086 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0\": container with ID starting with a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0 not found: ID does not exist" containerID="a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0" Jul 05 19:56:51.516181 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.516114 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0"} err="failed to get container status \"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0\": rpc error: code = NotFound desc = could not find container \"a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0\": container with ID starting with a7c1b3820ca1da4804968cb8adf0d61af2bf97175530b2fb615a24e906ff28f0 not found: ID does not exist" Jul 05 19:56:51.532297 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.532266 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:51.535877 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.535855 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-da4a26de-openshift-default-64c465d859-d94jf"] Jul 05 19:56:51.913020 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:56:51.912992 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" path="/var/lib/kubelet/pods/ccdbd105-6a69-48e2-9c45-1d8561e06cdb/volumes" Jul 05 19:58:24.679753 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.679653 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:24.680291 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.680060 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" containerName="istio-proxy" Jul 05 19:58:24.680291 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.680078 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" containerName="istio-proxy" Jul 05 19:58:24.680291 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.680192 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccdbd105-6a69-48e2-9c45-1d8561e06cdb" containerName="istio-proxy" Jul 05 19:58:24.683058 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.683039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.685210 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.685190 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a4a20bf3-openshift-default-dockercfg-7hct7\"" Jul 05 19:58:24.702582 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.702555 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:24.830447 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830623 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmr89\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830623 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830623 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830623 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830755 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830755 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830755 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.830755 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.830725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.931954 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.931879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.931954 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.931918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.931954 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.931936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932219 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.931960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932219 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932219 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932386 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932386 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmr89\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932386 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932386 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932579 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932616 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932837 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.932921 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.932806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.934570 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.934544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.934570 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.934558 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.939496 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.939472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.939589 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.939549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmr89\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89\") pod \"e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:24.993288 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:24.993262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:25.128262 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.128135 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:25.131090 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:58:25.131060 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395d3a7c_6ad8_4cb6_b958_2cfadb1cad20.slice/crio-22b42247be9ae789596e7ab3c9b6a8ff5b0c249c3a6daf1b14a75ac99c797849 WatchSource:0}: Error finding container 22b42247be9ae789596e7ab3c9b6a8ff5b0c249c3a6daf1b14a75ac99c797849: Status 404 returned error can't find the container with id 22b42247be9ae789596e7ab3c9b6a8ff5b0c249c3a6daf1b14a75ac99c797849 Jul 05 19:58:25.133406 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.133366 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:25.133473 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.133453 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:25.133521 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.133493 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:25.916126 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.916091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerStarted","Data":"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346"} Jul 05 19:58:25.916516 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.916159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerStarted","Data":"22b42247be9ae789596e7ab3c9b6a8ff5b0c249c3a6daf1b14a75ac99c797849"} Jul 05 19:58:25.934586 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.934524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" podStartSLOduration=1.934502916 podStartE2EDuration="1.934502916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:58:25.932661885 +0000 UTC m=+1704.559850338" watchObservedRunningTime="2026-07-05 19:58:25.934502916 +0000 UTC m=+1704.561691367" Jul 05 19:58:25.993982 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:25.993941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:26.998629 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:26.998597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:27.925405 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:27.925374 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:27.926477 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:27.926460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:40.982267 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.982234 2576 generic.go:356] "Generic (PLEG): container finished" podID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerID="93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346" exitCode=0 Jul 05 19:58:40.982679 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.982278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerDied","Data":"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346"} Jul 05 19:58:40.982679 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.982656 2576 scope.go:117] "RemoveContainer" containerID="93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346" Jul 05 19:58:40.983659 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.983620 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:40.983734 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.983701 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:40.983769 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:40.983732 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:58:41.990137 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:41.990100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerStarted","Data":"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade"} Jul 05 19:58:41.993520 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:41.993493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:42.925456 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:42.925421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:42.998649 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:42.998600 2576 patch_prober.go:28] interesting pod/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 05 19:58:42.999138 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:42.998669 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 05 19:58:43.994339 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:43.994289 2576 patch_prober.go:28] interesting pod/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 05 19:58:43.994525 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:43.994363 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 05 19:58:44.994678 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:44.994638 2576 patch_prober.go:28] interesting pod/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 05 19:58:44.995314 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:44.995283 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 05 19:58:45.800168 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:45.799761 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:45.807210 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:45.800452 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" containerID="cri-o://3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade" gracePeriod=30 Jul 05 19:58:51.671747 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.671719 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:51.767329 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767242 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767329 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767302 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmr89\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767363 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767408 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767489 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767542 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767519 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767821 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data\") pod \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\" (UID: \"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20\") " Jul 05 19:58:51.767985 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767947 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:58:51.768111 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.767956 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:58:51.768471 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.768443 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 19:58:51.768557 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.768517 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:58:51.768617 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.768594 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data" (OuterVolumeSpecName: "istio-data") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:58:51.769621 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.769591 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89" (OuterVolumeSpecName: "kube-api-access-wmr89") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "kube-api-access-wmr89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:58:51.769767 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.769747 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token" (OuterVolumeSpecName: "istio-token") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 19:58:51.770068 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.770041 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 19:58:51.770068 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.770054 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" (UID: "395d3a7c-6ad8-4cb6-b958-2cfadb1cad20"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 19:58:51.872381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872344 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872381 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872379 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872396 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872410 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872425 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872440 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872454 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872469 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmr89\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-kube-api-access-wmr89\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:51.872594 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:51.872479 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 19:58:52.041239 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.041136 2576 generic.go:356] "Generic (PLEG): container finished" podID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerID="3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade" exitCode=0 Jul 05 19:58:52.041239 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.041217 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" Jul 05 19:58:52.041434 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.041241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerDied","Data":"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade"} Jul 05 19:58:52.041434 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.041323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js" event={"ID":"395d3a7c-6ad8-4cb6-b958-2cfadb1cad20","Type":"ContainerDied","Data":"22b42247be9ae789596e7ab3c9b6a8ff5b0c249c3a6daf1b14a75ac99c797849"} Jul 05 19:58:52.041434 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.041345 2576 scope.go:117] "RemoveContainer" containerID="3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade" Jul 05 19:58:52.049548 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.049531 2576 scope.go:117] "RemoveContainer" containerID="93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346" Jul 05 19:58:52.057359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.057338 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:52.057645 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.057627 2576 scope.go:117] "RemoveContainer" containerID="3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade" Jul 05 19:58:52.057911 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:58:52.057892 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade\": container with ID starting with 3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade not found: ID does not exist" containerID="3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade" Jul 05 19:58:52.057967 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.057916 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade"} err="failed to get container status \"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade\": rpc error: code = NotFound desc = could not find container \"3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade\": container with ID starting with 3ae17dcb0433f5a42a3631523058f7681827226c7c758a8cd280e85447f8aade not found: ID does not exist" Jul 05 19:58:52.057967 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.057932 2576 scope.go:117] "RemoveContainer" containerID="93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346" Jul 05 19:58:52.058235 ip-10-0-142-62 kubenswrapper[2576]: E0705 19:58:52.058217 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346\": container with ID starting with 93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346 not found: ID does not exist" containerID="93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346" Jul 05 19:58:52.058282 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.058240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346"} err="failed to get container status \"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346\": rpc error: code = NotFound desc = could not find container \"93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346\": container with ID starting with 93eb061335d2df159fce2e6fdbd3fd4d0f9df09b34f0852f9f91367cd119f346 not found: ID does not exist" Jul 05 19:58:52.064053 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:52.064034 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a4a20bf3-openshift-default-5f44b5d5c9-xw9js"] Jul 05 19:58:53.912573 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:58:53.912541 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" path="/var/lib/kubelet/pods/395d3a7c-6ad8-4cb6-b958-2cfadb1cad20/volumes" Jul 05 19:59:04.795858 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.795821 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 19:59:04.796323 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.796276 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 19:59:04.796323 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.796292 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 19:59:04.796440 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.796377 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 19:59:04.796440 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.796388 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 19:59:04.799525 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.799506 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.801643 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.801625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5592633f-openshift-default-dockercfg-sg65f\"" Jul 05 19:59:04.810870 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.810847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 19:59:04.885773 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.885737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.885966 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.885780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.885966 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.885859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.885966 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.885912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.885966 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.885939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.886218 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.886008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqnqs\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.886218 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.886042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.886218 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.886074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.886218 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.886132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987291 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987291 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqnqs\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987526 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987789 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987789 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987789 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987789 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.987992 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.987788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.988102 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.988079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.988359 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.988338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.989856 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.989837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.990134 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.990118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.994671 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.994642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:04.994840 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:04.994822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqnqs\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs\") pod \"e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:05.110409 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:05.110379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:05.250280 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:05.250191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 19:59:05.252469 ip-10-0-142-62 kubenswrapper[2576]: W0705 19:59:05.252442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdcf121_a45d_497a_8ce6_b95a1b0795fe.slice/crio-7f2b1c1f421eabf7b4be129d1a89a83fc42c892e351ebdafe1695f321cdc7f16 WatchSource:0}: Error finding container 7f2b1c1f421eabf7b4be129d1a89a83fc42c892e351ebdafe1695f321cdc7f16: Status 404 returned error can't find the container with id 7f2b1c1f421eabf7b4be129d1a89a83fc42c892e351ebdafe1695f321cdc7f16 Jul 05 19:59:05.254560 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:05.254529 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:05.254653 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:05.254596 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:05.254653 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:05.254624 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:06.107862 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:06.107825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerStarted","Data":"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537"} Jul 05 19:59:06.108285 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:06.107880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerStarted","Data":"7f2b1c1f421eabf7b4be129d1a89a83fc42c892e351ebdafe1695f321cdc7f16"} Jul 05 19:59:06.110552 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:06.110533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:06.115266 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:06.115244 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:06.124672 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:06.124618 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podStartSLOduration=2.124600883 podStartE2EDuration="2.124600883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:59:06.124189539 +0000 UTC m=+1744.751377990" watchObservedRunningTime="2026-07-05 19:59:06.124600883 +0000 UTC m=+1744.751789335" Jul 05 19:59:07.112310 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:07.112282 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:07.113191 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:07.113172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:19.165738 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.165704 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerID="80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537" exitCode=0 Jul 05 19:59:19.166167 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.165784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerDied","Data":"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537"} Jul 05 19:59:19.166296 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.166280 2576 scope.go:117] "RemoveContainer" containerID="80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537" Jul 05 19:59:19.167373 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.167347 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:19.167440 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.167409 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:19.167475 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:19.167440 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 19:59:20.172472 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:20.172439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerStarted","Data":"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e"} Jul 05 19:59:21.110627 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:21.110581 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:21.111726 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:21.111700 2576 patch_prober.go:28] interesting pod/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 05 19:59:21.111845 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:21.111750 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 05 19:59:22.111752 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:22.111707 2576 patch_prober.go:28] interesting pod/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 05 19:59:22.112300 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:22.111760 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 05 19:59:22.112862 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:22.112838 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:23.111355 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:23.111308 2576 patch_prober.go:28] interesting pod/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 05 19:59:23.111533 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:23.111377 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 05 19:59:24.115357 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:24.115330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 19:59:24.116444 ip-10-0-142-62 kubenswrapper[2576]: I0705 19:59:24.116420 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 20:00:53.922936 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:53.922905 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 20:00:53.923492 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:53.923118 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" containerID="cri-o://7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e" gracePeriod=30 Jul 05 20:00:54.117788 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:54.117750 2576 patch_prober.go:28] interesting pod/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:00:54.117961 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:54.117825 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:00:59.178448 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.178411 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 20:00:59.280989 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.280901 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.280989 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.280948 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.280989 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.280982 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281010 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281062 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqnqs\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281126 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281208 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data\") pod \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\" (UID: \"fbdcf121-a45d-497a-8ce6-b95a1b0795fe\") " Jul 05 20:00:59.281601 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281298 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:00:59.281601 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281316 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:00:59.281601 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281449 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:00:59.281601 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281489 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.281601 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281507 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.281828 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.281729 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:00:59.282371 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.282345 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:00:59.283428 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.283396 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:00:59.283589 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.283562 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:00:59.283776 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.283748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:00:59.283926 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.283907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs" (OuterVolumeSpecName: "kube-api-access-gqnqs") pod "fbdcf121-a45d-497a-8ce6-b95a1b0795fe" (UID: "fbdcf121-a45d-497a-8ce6-b95a1b0795fe"). InnerVolumeSpecName "kube-api-access-gqnqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:00:59.382544 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382513 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382544 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382541 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382544 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382552 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqnqs\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-kube-api-access-gqnqs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382775 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382561 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382775 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382570 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382775 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382578 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.382775 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.382585 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcf121-a45d-497a-8ce6-b95a1b0795fe-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:00:59.607879 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.607843 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerID="7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e" exitCode=0 Jul 05 20:00:59.608077 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.607892 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" Jul 05 20:00:59.608077 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.607921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerDied","Data":"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e"} Jul 05 20:00:59.608077 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.607976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc" event={"ID":"fbdcf121-a45d-497a-8ce6-b95a1b0795fe","Type":"ContainerDied","Data":"7f2b1c1f421eabf7b4be129d1a89a83fc42c892e351ebdafe1695f321cdc7f16"} Jul 05 20:00:59.608077 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.608002 2576 scope.go:117] "RemoveContainer" containerID="7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e" Jul 05 20:00:59.617084 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.617067 2576 scope.go:117] "RemoveContainer" containerID="80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537" Jul 05 20:00:59.624875 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.624857 2576 scope.go:117] "RemoveContainer" containerID="7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e" Jul 05 20:00:59.625257 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:00:59.625225 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e\": container with ID starting with 7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e not found: ID does not exist" containerID="7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e" Jul 05 20:00:59.625367 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.625264 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e"} err="failed to get container status \"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e\": rpc error: code = NotFound desc = could not find container \"7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e\": container with ID starting with 7c954f4df0a0f215784732cc01b3fb726edb7ca610d62c5eb8be26448297017e not found: ID does not exist" Jul 05 20:00:59.625367 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.625286 2576 scope.go:117] "RemoveContainer" containerID="80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537" Jul 05 20:00:59.625761 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:00:59.625722 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537\": container with ID starting with 80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537 not found: ID does not exist" containerID="80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537" Jul 05 20:00:59.625882 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.625766 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537"} err="failed to get container status \"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537\": rpc error: code = NotFound desc = could not find container \"80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537\": container with ID starting with 80e50de53f0477d393946b2461fc94a0a024108672b63e65004deb1f62e58537 not found: ID does not exist" Jul 05 20:00:59.627427 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.627408 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 20:00:59.630020 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.630000 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5592633f-openshift-default-6cc948f5c5-tmtmc"] Jul 05 20:00:59.912735 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:00:59.912659 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" path="/var/lib/kubelet/pods/fbdcf121-a45d-497a-8ce6-b95a1b0795fe/volumes" Jul 05 20:01:48.013708 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.013627 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.013924 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.013934 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.013947 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.013952 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="395d3a7c-6ad8-4cb6-b958-2cfadb1cad20" containerName="istio-proxy" Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.014007 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:48.014179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.014016 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:48.016901 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.016886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.019000 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.018982 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6354d0-openshift-default-dockercfg-vkg2b\"" Jul 05 20:01:48.027237 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.027212 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:01:48.101728 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101728 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9m4\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.101945 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.102128 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.101943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203006 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.202963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203302 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203450 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9m4\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203570 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203728 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203826 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.203952 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.203939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.204073 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.204061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.204189 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.204176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.204709 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.204685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.205537 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.205513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.208456 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.208376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.209481 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.208645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.209481 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.208772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.209481 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.209198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.211357 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.211337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.216406 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.216371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.216582 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.216560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9m4\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4\") pod \"e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.329303 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.329268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:48.467435 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.467399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:01:48.470503 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:01:48.470469 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190d77b7_0997_4b12_8e52_f7527c1c4f18.slice/crio-47738cf73cfbd851c24467148ad473b651699a4cf488c7a0af33ddfaf0685d72 WatchSource:0}: Error finding container 47738cf73cfbd851c24467148ad473b651699a4cf488c7a0af33ddfaf0685d72: Status 404 returned error can't find the container with id 47738cf73cfbd851c24467148ad473b651699a4cf488c7a0af33ddfaf0685d72 Jul 05 20:01:48.472408 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.472376 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:48.472509 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.472441 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:48.472509 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.472468 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:48.820725 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.820688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerStarted","Data":"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1"} Jul 05 20:01:48.820911 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.820745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerStarted","Data":"47738cf73cfbd851c24467148ad473b651699a4cf488c7a0af33ddfaf0685d72"} Jul 05 20:01:48.838920 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:48.838864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podStartSLOduration=1.838848109 podStartE2EDuration="1.838848109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:01:48.837021828 +0000 UTC m=+1907.464210279" watchObservedRunningTime="2026-07-05 20:01:48.838848109 +0000 UTC m=+1907.466036559" Jul 05 20:01:49.329620 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:49.329584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:49.334549 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:49.334521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:49.825294 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:49.825265 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:49.826332 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:49.826314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:01:55.878371 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.878339 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:01:55.878827 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.878812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:55.878869 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.878830 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbdcf121-a45d-497a-8ce6-b95a1b0795fe" containerName="istio-proxy" Jul 05 20:01:55.882263 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.882240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.884419 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.884398 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-82d890-openshift-default-dockercfg-qh2wn\"" Jul 05 20:01:55.891368 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.891345 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:01:55.975278 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975432 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975633 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p6df\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:55.975633 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:55.975492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076025 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.075986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076025 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076308 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076308 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076308 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6df\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076308 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076515 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076515 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076515 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076673 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076748 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076883 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.076961 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.076891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.077179 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.077135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.079190 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.079171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.079417 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.079401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.083410 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.083390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p6df\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.083503 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.083406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token\") pod \"e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.194596 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.194510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:56.329118 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.329037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:01:56.331534 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:01:56.331506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b3904d_5a04_4ff8_91ed_0deecc7bbced.slice/crio-805906506b27bfa64d09df7dcfa92658a8dfe00e489565b435b5471933c51c01 WatchSource:0}: Error finding container 805906506b27bfa64d09df7dcfa92658a8dfe00e489565b435b5471933c51c01: Status 404 returned error can't find the container with id 805906506b27bfa64d09df7dcfa92658a8dfe00e489565b435b5471933c51c01 Jul 05 20:01:56.334073 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.334043 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:56.334167 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.334111 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:56.334216 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.334167 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:01:56.853943 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.853903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerStarted","Data":"9d63449bece31e98c64407e4ccb1c93d1d5b1c8332137f5571cd1888788f9905"} Jul 05 20:01:56.854097 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.853964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerStarted","Data":"805906506b27bfa64d09df7dcfa92658a8dfe00e489565b435b5471933c51c01"} Jul 05 20:01:56.872373 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:56.872321 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podStartSLOduration=1.872306367 podStartE2EDuration="1.872306367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:01:56.870957469 +0000 UTC m=+1915.498145915" watchObservedRunningTime="2026-07-05 20:01:56.872306367 +0000 UTC m=+1915.499494816" Jul 05 20:01:57.195729 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:57.195633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:57.200284 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:57.200258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:57.858624 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:57.858593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:01:57.859440 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:01:57.859423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:02:05.869309 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:05.869259 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 05 20:02:05.869789 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:05.869326 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 05 20:02:07.915210 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.915177 2576 generic.go:356] "Generic (PLEG): container finished" podID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerID="03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1" exitCode=0 Jul 05 20:02:07.915644 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.915256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerDied","Data":"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1"} Jul 05 20:02:07.915644 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.915633 2576 scope.go:117] "RemoveContainer" containerID="03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1" Jul 05 20:02:07.916642 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.916612 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:07.916790 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.916694 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:07.916790 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:07.916745 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:08.924542 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:08.924495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerStarted","Data":"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66"} Jul 05 20:02:09.330573 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:09.330524 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:02:09.330928 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:09.330599 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 05 20:02:09.331188 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:09.331133 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 05 20:02:10.330487 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:10.330451 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 05 20:02:10.330942 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:10.330510 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 05 20:02:11.330503 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:11.330458 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 05 20:02:11.330969 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:11.330524 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 05 20:02:12.329702 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:12.329666 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 05 20:02:12.329873 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:12.329733 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 05 20:02:13.178833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.177759 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:46450->10.134.0.30:15021: read: connection reset by peer" start-of-body= Jul 05 20:02:13.178833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.177840 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:46450->10.134.0.30:15021: read: connection reset by peer" Jul 05 20:02:13.333552 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.333525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:02:13.334038 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.334021 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:02:13.334649 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.334632 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:02:13.950349 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.950320 2576 generic.go:356] "Generic (PLEG): container finished" podID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerID="9d63449bece31e98c64407e4ccb1c93d1d5b1c8332137f5571cd1888788f9905" exitCode=0 Jul 05 20:02:13.950534 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.950394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerDied","Data":"9d63449bece31e98c64407e4ccb1c93d1d5b1c8332137f5571cd1888788f9905"} Jul 05 20:02:13.950913 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.950897 2576 scope.go:117] "RemoveContainer" containerID="9d63449bece31e98c64407e4ccb1c93d1d5b1c8332137f5571cd1888788f9905" Jul 05 20:02:13.951867 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.951843 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:13.951918 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.951906 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:13.951959 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:13.951938 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:02:14.957975 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:14.957940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerStarted","Data":"cc8920ae8f5a1f6dcc5cdd3d028b6a4f6cd73b94317cc38282bb32b5b645b943"} Jul 05 20:02:15.195235 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:15.195199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:02:15.195681 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:15.195564 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 05 20:02:15.195877 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:15.195854 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 05 20:02:16.195568 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:16.195522 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 05 20:02:16.196088 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:16.195606 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 05 20:02:17.195249 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:17.195209 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 05 20:02:17.195547 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:17.195517 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 05 20:02:18.195328 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:18.195235 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 05 20:02:18.195924 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:18.195889 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 05 20:02:19.195319 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:19.195278 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 05 20:02:19.195621 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:19.195581 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 05 20:02:20.198604 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:20.198566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:02:20.199057 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:20.198887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:02:20.199590 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:02:20.199573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:03:55.453448 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:03:55.453412 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:03:55.454129 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:03:55.453655 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" containerID="cri-o://0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66" gracePeriod=30 Jul 05 20:03:58.337084 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:03:58.337043 2576 patch_prober.go:28] interesting pod/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:03:58.337504 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:03:58.337127 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:04:00.698686 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.698661 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:04:00.801229 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801229 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801229 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801198 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801229 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801228 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801346 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz9m4\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801381 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token\") pod \"190d77b7-0997-4b12-8e52-f7527c1c4f18\" (UID: \"190d77b7-0997-4b12-8e52-f7527c1c4f18\") " Jul 05 20:04:00.801554 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801518 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801566 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801572 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801684 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801701 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190d77b7-0997-4b12-8e52-f7527c1c4f18-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801715 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.801855 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.801743 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:00.802727 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.802696 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data" (OuterVolumeSpecName: "istio-data") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:00.803825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.803794 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:00.803825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.803812 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4" (OuterVolumeSpecName: "kube-api-access-xz9m4") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "kube-api-access-xz9m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:00.803957 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.803857 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token" (OuterVolumeSpecName: "istio-token") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:00.803957 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.803888 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "190d77b7-0997-4b12-8e52-f7527c1c4f18" (UID: "190d77b7-0997-4b12-8e52-f7527c1c4f18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:04:00.902350 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902318 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.902350 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902344 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.902350 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902353 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.902350 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902361 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190d77b7-0997-4b12-8e52-f7527c1c4f18-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.902610 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902368 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz9m4\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-kube-api-access-xz9m4\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:00.902610 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:00.902377 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190d77b7-0997-4b12-8e52-f7527c1c4f18-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:01.424170 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.424115 2576 generic.go:356] "Generic (PLEG): container finished" podID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerID="0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66" exitCode=0 Jul 05 20:04:01.424358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.424180 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" Jul 05 20:04:01.424358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.424208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerDied","Data":"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66"} Jul 05 20:04:01.424358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.424266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc" event={"ID":"190d77b7-0997-4b12-8e52-f7527c1c4f18","Type":"ContainerDied","Data":"47738cf73cfbd851c24467148ad473b651699a4cf488c7a0af33ddfaf0685d72"} Jul 05 20:04:01.424358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.424291 2576 scope.go:117] "RemoveContainer" containerID="0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66" Jul 05 20:04:01.433319 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.433303 2576 scope.go:117] "RemoveContainer" containerID="03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1" Jul 05 20:04:01.440965 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.440943 2576 scope.go:117] "RemoveContainer" containerID="0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66" Jul 05 20:04:01.448193 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:01.445434 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66\": container with ID starting with 0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66 not found: ID does not exist" containerID="0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66" Jul 05 20:04:01.448193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.445476 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66"} err="failed to get container status \"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66\": rpc error: code = NotFound desc = could not find container \"0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66\": container with ID starting with 0f28b6160bf8af76676b3c651bf046930f77245a91891e9804996ccaeabb3d66 not found: ID does not exist" Jul 05 20:04:01.448193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.445505 2576 scope.go:117] "RemoveContainer" containerID="03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1" Jul 05 20:04:01.448684 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:01.448659 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1\": container with ID starting with 03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1 not found: ID does not exist" containerID="03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1" Jul 05 20:04:01.448789 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.448690 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1"} err="failed to get container status \"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1\": rpc error: code = NotFound desc = could not find container \"03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1\": container with ID starting with 03285421af05eed71b2773e7896fa7d4430089defc6fcf1e8488ece260c80cc1 not found: ID does not exist" Jul 05 20:04:01.448959 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.448937 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:04:01.450422 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.450404 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6354d0-openshift-default-55499f78d9-92ngc"] Jul 05 20:04:01.914361 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:01.914333 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" path="/var/lib/kubelet/pods/190d77b7-0997-4b12-8e52-f7527c1c4f18/volumes" Jul 05 20:04:02.266299 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:02.266212 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:04:02.266505 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:02.266482 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" containerID="cri-o://cc8920ae8f5a1f6dcc5cdd3d028b6a4f6cd73b94317cc38282bb32b5b645b943" gracePeriod=30 Jul 05 20:04:03.119817 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.119783 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:03.120250 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.120128 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:03.120250 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.120158 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:03.120250 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.120247 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:03.120372 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.120256 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:03.124409 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.124388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.126232 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.126207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a0ce36-openshift-default-dockercfg-nnxr8\"" Jul 05 20:04:03.134130 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.134105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:03.221977 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.221936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5fv\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.221977 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.221981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222300 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222300 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222300 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222300 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222300 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222462 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.222462 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.222340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323242 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323445 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5fv\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323776 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323776 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323776 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.323960 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.324022 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.324022 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.323964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.324348 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.324325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.325727 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.325708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.325934 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.325916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.330635 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.330611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5fv\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.330635 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.330627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token\") pod \"e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.436201 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.436095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:03.569523 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.569497 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:03.571997 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:04:03.571966 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1beb73f_cd26_4d57_85a5_035934e7f6ca.slice/crio-6b5f22f2cfc2e098da01b88f053f52000b4eccbe002bcc23df58a46972f8d7c0 WatchSource:0}: Error finding container 6b5f22f2cfc2e098da01b88f053f52000b4eccbe002bcc23df58a46972f8d7c0: Status 404 returned error can't find the container with id 6b5f22f2cfc2e098da01b88f053f52000b4eccbe002bcc23df58a46972f8d7c0 Jul 05 20:04:03.574177 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.574112 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:03.574254 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.574230 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:03.574305 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:03.574275 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:04.439646 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:04.439606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerStarted","Data":"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd"} Jul 05 20:04:04.440131 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:04.439694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerStarted","Data":"6b5f22f2cfc2e098da01b88f053f52000b4eccbe002bcc23df58a46972f8d7c0"} Jul 05 20:04:04.458207 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:04.458133 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podStartSLOduration=1.45811725 podStartE2EDuration="1.45811725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:04.456218369 +0000 UTC m=+2043.083406817" watchObservedRunningTime="2026-07-05 20:04:04.45811725 +0000 UTC m=+2043.085305703" Jul 05 20:04:05.200992 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.200950 2576 patch_prober.go:28] interesting pod/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:04:05.201181 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.201008 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:04:05.437117 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.437077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:05.442192 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.442163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:05.444615 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.444595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:05.445393 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:05.445370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:07.457876 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.457844 2576 generic.go:356] "Generic (PLEG): container finished" podID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerID="cc8920ae8f5a1f6dcc5cdd3d028b6a4f6cd73b94317cc38282bb32b5b645b943" exitCode=0 Jul 05 20:04:07.458512 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.457910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerDied","Data":"cc8920ae8f5a1f6dcc5cdd3d028b6a4f6cd73b94317cc38282bb32b5b645b943"} Jul 05 20:04:07.458512 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.457979 2576 scope.go:117] "RemoveContainer" containerID="9d63449bece31e98c64407e4ccb1c93d1d5b1c8332137f5571cd1888788f9905" Jul 05 20:04:07.523191 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.523162 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:04:07.659177 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659360 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659205 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p6df\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659360 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659239 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659360 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659257 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659360 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659271 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659360 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659354 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659647 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659382 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659647 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659409 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659647 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659516 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs\") pod \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\" (UID: \"11b3904d-5a04-4ff8-91ed-0deecc7bbced\") " Jul 05 20:04:07.659795 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659668 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:04:07.659885 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659822 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:07.659944 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659902 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:07.659997 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659953 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.659997 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.659975 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.660240 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.660220 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:07.660284 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.660238 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data" (OuterVolumeSpecName: "istio-data") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:07.661676 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.661640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:04:07.661676 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.661652 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df" (OuterVolumeSpecName: "kube-api-access-7p6df") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "kube-api-access-7p6df". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:07.662045 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.662023 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token" (OuterVolumeSpecName: "istio-token") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:07.662125 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.662105 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11b3904d-5a04-4ff8-91ed-0deecc7bbced" (UID: "11b3904d-5a04-4ff8-91ed-0deecc7bbced"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:07.760427 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760393 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760427 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760422 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760427 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760433 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760441 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760450 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p6df\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-kube-api-access-7p6df\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760459 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:07.760663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:07.760469 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3904d-5a04-4ff8-91ed-0deecc7bbced-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:08.464672 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:08.464642 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" Jul 05 20:04:08.465050 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:08.464684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn" event={"ID":"11b3904d-5a04-4ff8-91ed-0deecc7bbced","Type":"ContainerDied","Data":"805906506b27bfa64d09df7dcfa92658a8dfe00e489565b435b5471933c51c01"} Jul 05 20:04:08.465050 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:08.464744 2576 scope.go:117] "RemoveContainer" containerID="cc8920ae8f5a1f6dcc5cdd3d028b6a4f6cd73b94317cc38282bb32b5b645b943" Jul 05 20:04:08.479758 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:08.479730 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:04:08.481919 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:08.481897 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-82d890-openshift-default-764544cdcc-trlqn"] Jul 05 20:04:09.912716 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:09.912683 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" path="/var/lib/kubelet/pods/11b3904d-5a04-4ff8-91ed-0deecc7bbced/volumes" Jul 05 20:04:11.656921 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.656886 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:11.657403 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657388 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:11.657452 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657407 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="190d77b7-0997-4b12-8e52-f7527c1c4f18" containerName="istio-proxy" Jul 05 20:04:11.657452 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657420 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.657452 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657428 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.657452 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657437 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.657452 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657445 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.657590 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657520 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.657590 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.657529 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b3904d-5a04-4ff8-91ed-0deecc7bbced" containerName="istio-proxy" Jul 05 20:04:11.661970 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.661943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.663914 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.663893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c7ee33-openshift-default-dockercfg-l5tk7\"" Jul 05 20:04:11.671900 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.671871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:11.795930 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.795890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.795930 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.795931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.795962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.795989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.796037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxsj\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.796063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.796086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.796116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.796217 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.796130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897609 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.897791 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898080 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxsj\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898080 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.897826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898080 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.898059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898262 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.898213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898262 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.898239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.898313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.898572 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.898547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.900302 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.900283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.900436 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.900416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.911950 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.911889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxsj\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.912190 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.912167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token\") pod \"e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:11.973561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:11.973525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:12.120600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.120435 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:12.123158 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:04:12.123115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafda861_dfc1_4bd7_bc88_cff2a2280e8e.slice/crio-fd02b56efdb005108c32084a0e41a21bd83c96737a071e0a00eec9bafb48e1b6 WatchSource:0}: Error finding container fd02b56efdb005108c32084a0e41a21bd83c96737a071e0a00eec9bafb48e1b6: Status 404 returned error can't find the container with id fd02b56efdb005108c32084a0e41a21bd83c96737a071e0a00eec9bafb48e1b6 Jul 05 20:04:12.125262 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.125228 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:12.125343 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.125294 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:12.125343 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.125321 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:12.486918 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.486805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerStarted","Data":"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf"} Jul 05 20:04:12.486918 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.486877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerStarted","Data":"fd02b56efdb005108c32084a0e41a21bd83c96737a071e0a00eec9bafb48e1b6"} Jul 05 20:04:12.507092 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.507016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podStartSLOduration=1.506992564 podStartE2EDuration="1.506992564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:12.504314359 +0000 UTC m=+2051.131502810" watchObservedRunningTime="2026-07-05 20:04:12.506992564 +0000 UTC m=+2051.134181017" Jul 05 20:04:12.974327 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:12.974275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:13.978934 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:13.978906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:14.501940 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:14.501822 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:14.507752 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:14.507719 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:19.528057 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.527961 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerID="90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd" exitCode=0 Jul 05 20:04:19.528057 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.528035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerDied","Data":"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd"} Jul 05 20:04:19.528626 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.528556 2576 scope.go:117] "RemoveContainer" containerID="90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd" Jul 05 20:04:19.529607 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.529578 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:19.529710 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.529654 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:19.529710 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:19.529689 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:20.445040 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:20.444993 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:20.534843 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:20.534811 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerStarted","Data":"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677"} Jul 05 20:04:21.436473 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:21.436437 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:21.437624 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:21.437592 2576 patch_prober.go:28] interesting pod/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 05 20:04:21.437738 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:21.437661 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 05 20:04:22.437123 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:22.437077 2576 patch_prober.go:28] interesting pod/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 05 20:04:22.437541 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:22.437185 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 05 20:04:23.436631 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:23.436598 2576 patch_prober.go:28] interesting pod/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 05 20:04:23.436841 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:23.436774 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 05 20:04:24.437431 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:24.437385 2576 patch_prober.go:28] interesting pod/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 05 20:04:24.437922 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:24.437463 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 05 20:04:25.440904 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:25.440871 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:25.441376 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:25.441182 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:25.441897 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:25.441881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:29.502850 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.502752 2576 patch_prober.go:28] interesting pod/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 05 20:04:29.502850 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.502814 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 05 20:04:29.578076 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.578043 2576 generic.go:356] "Generic (PLEG): container finished" podID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerID="e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf" exitCode=0 Jul 05 20:04:29.578266 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.578105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerDied","Data":"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf"} Jul 05 20:04:29.578530 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.578516 2576 scope.go:117] "RemoveContainer" containerID="e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf" Jul 05 20:04:29.579559 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.579526 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:29.579649 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.579630 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:29.579691 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:29.579674 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:30.584609 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:30.584577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerStarted","Data":"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6"} Jul 05 20:04:30.974362 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:30.974278 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:30.974508 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:30.974473 2576 patch_prober.go:28] interesting pod/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 05 20:04:30.974550 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:30.974518 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 05 20:04:31.974235 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:31.974202 2576 patch_prober.go:28] interesting pod/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 05 20:04:31.974619 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:31.974258 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 05 20:04:32.974771 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:32.974726 2576 patch_prober.go:28] interesting pod/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 05 20:04:32.975289 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:32.974789 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 05 20:04:33.311238 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:33.305805 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:33.311238 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:33.306073 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" containerID="cri-o://a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677" gracePeriod=30 Jul 05 20:04:33.974972 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:33.974936 2576 patch_prober.go:28] interesting pod/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 05 20:04:33.975404 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:33.974994 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 05 20:04:34.979165 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:34.979114 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:34.979612 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:34.979588 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:34.980479 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:34.980458 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:38.591240 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.591215 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:38.632580 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.632543 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerID="a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677" exitCode=0 Jul 05 20:04:38.632744 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.632596 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" Jul 05 20:04:38.632744 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.632609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerDied","Data":"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677"} Jul 05 20:04:38.632744 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.632686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24" event={"ID":"e1beb73f-cd26-4d57-85a5-035934e7f6ca","Type":"ContainerDied","Data":"6b5f22f2cfc2e098da01b88f053f52000b4eccbe002bcc23df58a46972f8d7c0"} Jul 05 20:04:38.632744 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.632711 2576 scope.go:117] "RemoveContainer" containerID="a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677" Jul 05 20:04:38.641141 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.641124 2576 scope.go:117] "RemoveContainer" containerID="90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd" Jul 05 20:04:38.648470 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.648454 2576 scope.go:117] "RemoveContainer" containerID="a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677" Jul 05 20:04:38.648741 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:38.648721 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677\": container with ID starting with a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677 not found: ID does not exist" containerID="a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677" Jul 05 20:04:38.648792 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.648749 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677"} err="failed to get container status \"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677\": rpc error: code = NotFound desc = could not find container \"a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677\": container with ID starting with a43a1c6c9705123df2c67943f0694d8922bb2142711c6c59d6e170f79b6e3677 not found: ID does not exist" Jul 05 20:04:38.648792 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.648767 2576 scope.go:117] "RemoveContainer" containerID="90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd" Jul 05 20:04:38.649001 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:38.648985 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd\": container with ID starting with 90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd not found: ID does not exist" containerID="90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd" Jul 05 20:04:38.649042 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.649007 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd"} err="failed to get container status \"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd\": rpc error: code = NotFound desc = could not find container \"90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd\": container with ID starting with 90d898d4c6629f6910f235a1913063b89f7463830dd9ef7426f6e4a8c85f5fbd not found: ID does not exist" Jul 05 20:04:38.657318 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657383 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m5fv\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657383 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657455 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657386 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657455 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657455 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657446 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657618 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657593 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657746 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657746 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657678 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket\") pod \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\" (UID: \"e1beb73f-cd26-4d57-85a5-035934e7f6ca\") " Jul 05 20:04:38.657861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657755 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:38.657861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657843 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:04:38.658013 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.657968 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:38.658377 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.658279 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:38.658377 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.658287 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.658377 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.658331 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.658377 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.658349 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.658632 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.658492 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:38.659736 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.659703 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:38.659837 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.659759 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv" (OuterVolumeSpecName: "kube-api-access-8m5fv") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "kube-api-access-8m5fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:38.659946 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.659838 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:04:38.659946 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.659907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1beb73f-cd26-4d57-85a5-035934e7f6ca" (UID: "e1beb73f-cd26-4d57-85a5-035934e7f6ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:38.759127 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759089 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.759127 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759121 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.759127 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759130 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.759127 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759138 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.759423 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759173 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m5fv\" (UniqueName: \"kubernetes.io/projected/e1beb73f-cd26-4d57-85a5-035934e7f6ca-kube-api-access-8m5fv\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.759423 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.759184 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1beb73f-cd26-4d57-85a5-035934e7f6ca-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:38.952837 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.952807 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:38.955832 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:38.955803 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a0ce36-openshift-default-78d857d87-bdm24"] Jul 05 20:04:39.912838 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:39.912798 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" path="/var/lib/kubelet/pods/e1beb73f-cd26-4d57-85a5-035934e7f6ca/volumes" Jul 05 20:04:39.979820 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:39.979788 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:39.980044 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:39.980019 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" containerID="cri-o://edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6" gracePeriod=30 Jul 05 20:04:40.757415 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757345 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:04:40.757825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757810 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.757932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757827 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.757932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757839 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.757932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757848 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.757932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757915 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.757932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.757927 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beb73f-cd26-4d57-85a5-035934e7f6ca" containerName="istio-proxy" Jul 05 20:04:40.762609 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.762587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.764744 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.764725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ec8ab7-openshift-default-dockercfg-xlvkl\"" Jul 05 20:04:40.773409 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.773389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:04:40.875811 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.875768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.875991 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.875821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.875991 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.875869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.875991 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.875918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.875991 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.875965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.876505 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.876022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmwq\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.876505 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.876062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.876505 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.876104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.876505 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.876249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977156 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmwq\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.977662 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.978293 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.978293 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.978293 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.978293 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.977880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.978293 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.978109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.979777 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.979754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.980171 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.980136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.984722 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.984702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:40.984921 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:40.984898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmwq\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq\") pod \"e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:41.073180 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.073123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:41.208632 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.208603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:04:41.211229 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:04:41.211201 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fd26a8_2ca7_426a_978c_520d37cdd849.slice/crio-c6d50c01c082370d5a97795aad5e455d97646b4fb529ee1043c4e91b76aa5f78 WatchSource:0}: Error finding container c6d50c01c082370d5a97795aad5e455d97646b4fb529ee1043c4e91b76aa5f78: Status 404 returned error can't find the container with id c6d50c01c082370d5a97795aad5e455d97646b4fb529ee1043c4e91b76aa5f78 Jul 05 20:04:41.213405 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.213374 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:41.213487 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.213444 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:41.213487 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.213473 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:41.648594 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.648557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerStarted","Data":"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d"} Jul 05 20:04:41.648792 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.648617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerStarted","Data":"c6d50c01c082370d5a97795aad5e455d97646b4fb529ee1043c4e91b76aa5f78"} Jul 05 20:04:41.667290 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:41.667242 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podStartSLOduration=1.667226034 podStartE2EDuration="1.667226034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:41.665325327 +0000 UTC m=+2080.292513769" watchObservedRunningTime="2026-07-05 20:04:41.667226034 +0000 UTC m=+2080.294414566" Jul 05 20:04:42.073997 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:42.073966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:42.078817 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:42.078794 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:42.652760 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:42.652721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:42.653574 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:42.653550 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:45.225253 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.225228 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:45.317642 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317617 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317689 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317707 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317774 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317791 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.317825 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317816 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztxsj\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.318186 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317854 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs\") pod \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\" (UID: \"dafda861-dfc1-4bd7-bc88-cff2a2280e8e\") " Jul 05 20:04:45.318186 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317927 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:45.318186 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.317988 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:45.318356 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.318195 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:04:45.318356 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.318214 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.318356 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.318233 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.318356 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.318265 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:45.318771 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.318736 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:45.320197 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.320165 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:45.320197 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.320175 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj" (OuterVolumeSpecName: "kube-api-access-ztxsj") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "kube-api-access-ztxsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:04:45.320520 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.320494 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:04:45.320617 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.320569 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dafda861-dfc1-4bd7-bc88-cff2a2280e8e" (UID: "dafda861-dfc1-4bd7-bc88-cff2a2280e8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:04:45.418822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418780 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.418822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418815 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.418822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418823 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.418822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418831 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.418822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418838 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.419133 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418848 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztxsj\" (UniqueName: \"kubernetes.io/projected/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-kube-api-access-ztxsj\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.419133 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.418857 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafda861-dfc1-4bd7-bc88-cff2a2280e8e-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:04:45.667212 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.667120 2576 generic.go:356] "Generic (PLEG): container finished" podID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerID="edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6" exitCode=0 Jul 05 20:04:45.667212 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.667181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerDied","Data":"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6"} Jul 05 20:04:45.667406 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.667236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" event={"ID":"dafda861-dfc1-4bd7-bc88-cff2a2280e8e","Type":"ContainerDied","Data":"fd02b56efdb005108c32084a0e41a21bd83c96737a071e0a00eec9bafb48e1b6"} Jul 05 20:04:45.667406 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.667258 2576 scope.go:117] "RemoveContainer" containerID="edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6" Jul 05 20:04:45.667406 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.667189 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5" Jul 05 20:04:45.676591 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.676576 2576 scope.go:117] "RemoveContainer" containerID="e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf" Jul 05 20:04:45.684272 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.684254 2576 scope.go:117] "RemoveContainer" containerID="edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6" Jul 05 20:04:45.684537 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:45.684515 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6\": container with ID starting with edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6 not found: ID does not exist" containerID="edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6" Jul 05 20:04:45.684599 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.684546 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6"} err="failed to get container status \"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6\": rpc error: code = NotFound desc = could not find container \"edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6\": container with ID starting with edd7ee8742d9783c5d11832d6202270711b3a02037a7daf7542c187799a09dd6 not found: ID does not exist" Jul 05 20:04:45.684599 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.684564 2576 scope.go:117] "RemoveContainer" containerID="e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf" Jul 05 20:04:45.684804 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:04:45.684788 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf\": container with ID starting with e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf not found: ID does not exist" containerID="e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf" Jul 05 20:04:45.684842 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.684811 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf"} err="failed to get container status \"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf\": rpc error: code = NotFound desc = could not find container \"e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf\": container with ID starting with e34e6bcdf25c9679abd1f32d4a1c6639970f14b993b93fb9d4725ae630e32fcf not found: ID does not exist" Jul 05 20:04:45.687523 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.687501 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:45.695684 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.695664 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c7ee33-openshift-default-c698d97f7-bdbb5"] Jul 05 20:04:45.912700 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:45.912667 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" path="/var/lib/kubelet/pods/dafda861-dfc1-4bd7-bc88-cff2a2280e8e/volumes" Jul 05 20:04:48.721017 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.720977 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:04:48.721561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.721523 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:04:48.721561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.721544 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:04:48.721561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.721563 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:04:48.721805 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.721572 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:04:48.721805 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.721638 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:04:48.726200 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.726180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.728297 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.728274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c11b28-openshift-default-dockercfg-fs5jg\"" Jul 05 20:04:48.736043 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.736016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:04:48.851392 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851392 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxrj\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.851822 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.851707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952405 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952561 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952832 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952832 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952832 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxrj\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.952990 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.952924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.953224 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.953192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.953370 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.953247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.953433 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.953379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.953485 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.953433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.955037 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.955014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.955218 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.955196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.959841 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.959822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxrj\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:48.960000 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:48.959979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token\") pod \"e2e-shared-b-c11b28-openshift-default-8674884695-n75jg\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:49.037364 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.037277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:49.172614 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.172588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:04:49.174992 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:04:49.174961 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc742a54b_ed12_4bf5_998b_8b8da1a6109d.slice/crio-634a0d32dea97a1c46c4906acb56d474d40488a1f0b5a0ce62da293692e3a268 WatchSource:0}: Error finding container 634a0d32dea97a1c46c4906acb56d474d40488a1f0b5a0ce62da293692e3a268: Status 404 returned error can't find the container with id 634a0d32dea97a1c46c4906acb56d474d40488a1f0b5a0ce62da293692e3a268 Jul 05 20:04:49.177239 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.177200 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:49.177346 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.177289 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:49.177346 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.177333 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:49.687135 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.687091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerStarted","Data":"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1"} Jul 05 20:04:49.687374 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.687192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerStarted","Data":"634a0d32dea97a1c46c4906acb56d474d40488a1f0b5a0ce62da293692e3a268"} Jul 05 20:04:49.710932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:49.710865 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podStartSLOduration=1.71084123 podStartE2EDuration="1.71084123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:49.708009504 +0000 UTC m=+2088.335197980" watchObservedRunningTime="2026-07-05 20:04:49.71084123 +0000 UTC m=+2088.338029682" Jul 05 20:04:50.038041 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:50.037952 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:50.042857 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:50.042830 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:50.694856 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:50.694824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:50.700777 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:50.700735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:04:56.730121 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.730087 2576 generic.go:356] "Generic (PLEG): container finished" podID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerID="06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d" exitCode=0 Jul 05 20:04:56.730716 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.730189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerDied","Data":"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d"} Jul 05 20:04:56.730716 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.730670 2576 scope.go:117] "RemoveContainer" containerID="06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d" Jul 05 20:04:56.731728 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.731700 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:56.731788 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.731771 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:56.731834 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:56.731803 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:04:57.653658 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:57.653608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:57.740175 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:57.740124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerStarted","Data":"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d"} Jul 05 20:04:58.074252 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:58.074206 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:04:58.075488 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:58.075460 2576 patch_prober.go:28] interesting pod/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 05 20:04:58.075676 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:58.075523 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 05 20:04:59.074211 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:59.074138 2576 patch_prober.go:28] interesting pod/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 05 20:04:59.074630 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:04:59.074237 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 05 20:05:00.074141 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:00.074102 2576 patch_prober.go:28] interesting pod/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 05 20:05:00.074361 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:00.074173 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 05 20:05:01.074247 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:01.074208 2576 patch_prober.go:28] interesting pod/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 05 20:05:01.074431 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:01.074272 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 05 20:05:02.078349 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:02.078319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:05:02.078743 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:02.078565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:05:02.079424 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:02.079408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:05:04.773984 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.773953 2576 generic.go:356] "Generic (PLEG): container finished" podID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerID="2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1" exitCode=0 Jul 05 20:05:04.774477 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.774030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerDied","Data":"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1"} Jul 05 20:05:04.774477 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.774465 2576 scope.go:117] "RemoveContainer" containerID="2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1" Jul 05 20:05:04.775524 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.775493 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:05:04.775638 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.775562 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:05:04.775638 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:04.775597 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892176Ki","pods":"250"} Jul 05 20:05:05.695349 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:05.695247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:05:05.780594 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:05.780562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerStarted","Data":"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a"} Jul 05 20:05:06.038014 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:06.037920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:05:06.039011 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:06.038985 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 05 20:05:06.039136 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:06.039055 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 05 20:05:07.037767 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:07.037729 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 05 20:05:07.038182 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:07.037788 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 05 20:05:08.038475 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:08.038437 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 05 20:05:08.038880 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:08.038495 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 05 20:05:09.037735 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:09.037690 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 05 20:05:09.037923 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:09.037753 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 05 20:05:10.041699 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:10.041664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:05:10.042075 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:10.042060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:05:10.042757 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:05:10.042741 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:11:17.064779 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:17.064741 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:11:17.065287 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:17.065001 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" containerID="cri-o://9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d" gracePeriod=30 Jul 05 20:11:17.080516 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:17.080480 2576 patch_prober.go:28] interesting pod/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:11:17.080637 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:17.080532 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:11:22.317723 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.317696 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:11:22.389816 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.389816 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.389816 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.389816 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389828 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zmwq\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.389927 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs\") pod \"48fd26a8-2ca7-426a-978c-520d37cdd849\" (UID: \"48fd26a8-2ca7-426a-978c-520d37cdd849\") " Jul 05 20:11:22.390193 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.390078 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:22.390516 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.390250 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.390516 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.390300 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:11:22.390516 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.390333 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:22.390516 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.390493 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:22.391064 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.391034 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data" (OuterVolumeSpecName: "istio-data") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:22.392201 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.392174 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token" (OuterVolumeSpecName: "istio-token") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:11:22.392365 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.392339 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:11:22.392417 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.392362 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq" (OuterVolumeSpecName: "kube-api-access-8zmwq") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "kube-api-access-8zmwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:11:22.392454 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.392429 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48fd26a8-2ca7-426a-978c-520d37cdd849" (UID: "48fd26a8-2ca7-426a-978c-520d37cdd849"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:22.424526 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.424493 2576 generic.go:356] "Generic (PLEG): container finished" podID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerID="9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d" exitCode=0 Jul 05 20:11:22.424671 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.424543 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" Jul 05 20:11:22.424671 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.424556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerDied","Data":"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d"} Jul 05 20:11:22.424671 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.424608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh" event={"ID":"48fd26a8-2ca7-426a-978c-520d37cdd849","Type":"ContainerDied","Data":"c6d50c01c082370d5a97795aad5e455d97646b4fb529ee1043c4e91b76aa5f78"} Jul 05 20:11:22.424671 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.424631 2576 scope.go:117] "RemoveContainer" containerID="9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d" Jul 05 20:11:22.433694 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.433675 2576 scope.go:117] "RemoveContainer" containerID="06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d" Jul 05 20:11:22.441559 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.441544 2576 scope.go:117] "RemoveContainer" containerID="9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d" Jul 05 20:11:22.441807 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:11:22.441789 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d\": container with ID starting with 9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d not found: ID does not exist" containerID="9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d" Jul 05 20:11:22.441846 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.441816 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d"} err="failed to get container status \"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d\": rpc error: code = NotFound desc = could not find container \"9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d\": container with ID starting with 9c4ebe5dc3e6446430e3b3ec8db93c568689f4c5604acb176301eef3a0be0a3d not found: ID does not exist" Jul 05 20:11:22.441846 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.441830 2576 scope.go:117] "RemoveContainer" containerID="06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d" Jul 05 20:11:22.442026 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:11:22.442012 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d\": container with ID starting with 06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d not found: ID does not exist" containerID="06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d" Jul 05 20:11:22.442063 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.442029 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d"} err="failed to get container status \"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d\": rpc error: code = NotFound desc = could not find container \"06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d\": container with ID starting with 06245d9483fc274dcc3337c5a23dc5b53b7eed612280292b62b985cdb718fa3d not found: ID does not exist" Jul 05 20:11:22.445605 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.445583 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:11:22.449137 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.449116 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ec8ab7-openshift-default-5d5bf49bf5-xhmlh"] Jul 05 20:11:22.490785 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490755 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.490785 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490782 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48fd26a8-2ca7-426a-978c-520d37cdd849-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.490785 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490794 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.491021 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490805 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zmwq\" (UniqueName: \"kubernetes.io/projected/48fd26a8-2ca7-426a-978c-520d37cdd849-kube-api-access-8zmwq\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.491021 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490819 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.491021 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490831 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.491021 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490843 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:22.491021 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:22.490855 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48fd26a8-2ca7-426a-978c-520d37cdd849-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:23.914698 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:23.914664 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" path="/var/lib/kubelet/pods/48fd26a8-2ca7-426a-978c-520d37cdd849/volumes" Jul 05 20:11:23.919727 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:23.919695 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:11:23.919915 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:23.919892 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" containerID="cri-o://db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a" gracePeriod=30 Jul 05 20:11:25.044251 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:25.044216 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 20:11:25.044716 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:25.044289 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 20:11:29.171136 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.171110 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:11:29.349057 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349027 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349067 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349085 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqxrj\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349213 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349277 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data\") pod \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\" (UID: \"c742a54b-ed12-4bf5-998b-8b8da1a6109d\") " Jul 05 20:11:29.349600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:29.349600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349460 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:29.349600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349575 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:29.349833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349620 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 20:11:29.349833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349694 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istiod-ca-cert\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.349833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349711 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-credential-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.349833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349729 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-certs\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.349833 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.349743 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-workload-socket\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.350301 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.350241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:29.351586 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.351557 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj" (OuterVolumeSpecName: "kube-api-access-bqxrj") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "kube-api-access-bqxrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:11:29.351702 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.351667 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 20:11:29.351932 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.351917 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 20:11:29.351969 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.351957 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c742a54b-ed12-4bf5-998b-8b8da1a6109d" (UID: "c742a54b-ed12-4bf5-998b-8b8da1a6109d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 20:11:29.450794 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.450765 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-envoy\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.450794 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.450789 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.450794 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.450797 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-data\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.451015 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.450805 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c742a54b-ed12-4bf5-998b-8b8da1a6109d-istio-podinfo\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.451015 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.450813 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqxrj\" (UniqueName: \"kubernetes.io/projected/c742a54b-ed12-4bf5-998b-8b8da1a6109d-kube-api-access-bqxrj\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\"" Jul 05 20:11:29.463062 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.463034 2576 generic.go:356] "Generic (PLEG): container finished" podID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerID="db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a" exitCode=0 Jul 05 20:11:29.463230 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.463084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerDied","Data":"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a"} Jul 05 20:11:29.463230 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.463089 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" Jul 05 20:11:29.463230 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.463168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg" event={"ID":"c742a54b-ed12-4bf5-998b-8b8da1a6109d","Type":"ContainerDied","Data":"634a0d32dea97a1c46c4906acb56d474d40488a1f0b5a0ce62da293692e3a268"} Jul 05 20:11:29.463230 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.463194 2576 scope.go:117] "RemoveContainer" containerID="db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a" Jul 05 20:11:29.471838 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.471820 2576 scope.go:117] "RemoveContainer" containerID="2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1" Jul 05 20:11:29.479235 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.479214 2576 scope.go:117] "RemoveContainer" containerID="db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a" Jul 05 20:11:29.479495 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:11:29.479474 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a\": container with ID starting with db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a not found: ID does not exist" containerID="db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a" Jul 05 20:11:29.479551 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.479504 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a"} err="failed to get container status \"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a\": rpc error: code = NotFound desc = could not find container \"db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a\": container with ID starting with db57b3411859181e62e92243f4378e77c75202040d165c0deb48b5a87d56437a not found: ID does not exist" Jul 05 20:11:29.479551 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.479521 2576 scope.go:117] "RemoveContainer" containerID="2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1" Jul 05 20:11:29.479782 ip-10-0-142-62 kubenswrapper[2576]: E0705 20:11:29.479763 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1\": container with ID starting with 2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1 not found: ID does not exist" containerID="2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1" Jul 05 20:11:29.479835 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.479788 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1"} err="failed to get container status \"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1\": rpc error: code = NotFound desc = could not find container \"2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1\": container with ID starting with 2be344eb7fae226a60848898153dec13914be48ef7a85e69141e69c79d7e6ec1 not found: ID does not exist" Jul 05 20:11:29.482752 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.482731 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:11:29.486815 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.486793 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c11b28-openshift-default-8674884695-n75jg"] Jul 05 20:11:29.912531 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:29.912500 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" path="/var/lib/kubelet/pods/c742a54b-ed12-4bf5-998b-8b8da1a6109d/volumes" Jul 05 20:11:30.074769 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:30.074742 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68674bcb-6qhf5_5a8c0887-e702-48be-981c-7d7f17aeb0e1/copy-manifests/0.log" Jul 05 20:11:30.081806 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:30.081776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68674bcb-6qhf5_5a8c0887-e702-48be-981c-7d7f17aeb0e1/manager/0.log" Jul 05 20:11:32.705819 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:32.705791 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678v97tf_b8fd4f69-fd56-4e8b-b61e-5c0816874317/istio-proxy/0.log" Jul 05 20:11:32.835694 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:32.835661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7j7rz_0a75cee0-2ca4-4fca-8086-732e5469454c/discovery/0.log" Jul 05 20:11:33.196874 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:33.196842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/1.log" Jul 05 20:11:33.987415 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:33.987385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-v8chl_ee5e2cc3-3c38-4bd1-be18-bee5936bf977/main/0.log" Jul 05 20:11:34.316320 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:34.316291 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xgdf2_2f08fc15-0008-4fbe-a2e3-3d37588a6785/main/0.log" Jul 05 20:11:41.118531 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:41.118501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrkl7_5b24635a-4786-43cd-8848-b17846a11b8e/global-pull-secret-syncer/0.log" Jul 05 20:11:41.196766 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:41.196732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lj5gq_6046108d-0beb-4a3b-b912-c507e6648305/konnectivity-agent/0.log" Jul 05 20:11:41.268041 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:41.268005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-62.ec2.internal_fa989e2b9c54417bc1c6df0ae2205504/haproxy/0.log" Jul 05 20:11:48.489220 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:48.489175 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kvbx_93886758-6c52-46c1-9d96-55c2ff5b52de/node-exporter/0.log" Jul 05 20:11:48.507640 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:48.507613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kvbx_93886758-6c52-46c1-9d96-55c2ff5b52de/kube-rbac-proxy/0.log" Jul 05 20:11:48.528768 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:48.528744 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kvbx_93886758-6c52-46c1-9d96-55c2ff5b52de/init-textfile/0.log" Jul 05 20:11:48.890808 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:48.890777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-h25qk_37f987fd-7ea2-47f5-a53f-620dfc939fba/prometheus-operator/0.log" Jul 05 20:11:48.909575 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:48.909548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-h25qk_37f987fd-7ea2-47f5-a53f-620dfc939fba/kube-rbac-proxy/0.log" Jul 05 20:11:50.424672 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:50.424634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-2b7fz_83187990-7222-4321-8aad-aed141714e85/networking-console-plugin/0.log" Jul 05 20:11:51.681349 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681311 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld"] Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681658 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681670 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681684 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681689 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681699 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681707 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681722 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.681741 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681728 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.681998 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681777 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48fd26a8-2ca7-426a-978c-520d37cdd849" containerName="istio-proxy" Jul 05 20:11:51.681998 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681787 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafda861-dfc1-4bd7-bc88-cff2a2280e8e" containerName="istio-proxy" Jul 05 20:11:51.681998 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681799 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.681998 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.681806 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c742a54b-ed12-4bf5-998b-8b8da1a6109d" containerName="istio-proxy" Jul 05 20:11:51.685726 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.685703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.687716 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.687686 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-27wzv\"/\"openshift-service-ca.crt\"" Jul 05 20:11:51.687843 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.687713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-27wzv\"/\"kube-root-ca.crt\"" Jul 05 20:11:51.688353 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.688339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-27wzv\"/\"default-dockercfg-62j8p\"" Jul 05 20:11:51.694025 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.693998 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld"] Jul 05 20:11:51.738224 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.738179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-lib-modules\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.738424 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.738255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msbg2\" (UniqueName: \"kubernetes.io/projected/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-kube-api-access-msbg2\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.738424 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.738285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-podres\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.738424 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.738380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-proc\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.738424 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.738413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-sys\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-proc\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839663 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-sys\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-lib-modules\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msbg2\" (UniqueName: \"kubernetes.io/projected/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-kube-api-access-msbg2\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-podres\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.839861 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-proc\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.840004 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-sys\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.840004 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-lib-modules\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.840004 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.839872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-podres\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.846638 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.846615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msbg2\" (UniqueName: \"kubernetes.io/projected/1eccad33-03a6-4cbf-9947-cd8c0a2e182f-kube-api-access-msbg2\") pod \"perf-node-gather-daemonset-rvfld\" (UID: \"1eccad33-03a6-4cbf-9947-cd8c0a2e182f\") " pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:51.996346 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:51.996266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:52.125049 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:52.125023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld"] Jul 05 20:11:52.127133 ip-10-0-142-62 kubenswrapper[2576]: W0705 20:11:52.127101 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1eccad33_03a6_4cbf_9947_cd8c0a2e182f.slice/crio-20b5aeb5b4a8105b4f18b616e035b0ebf3263c591256fc8ad96424785ddaeccd WatchSource:0}: Error finding container 20b5aeb5b4a8105b4f18b616e035b0ebf3263c591256fc8ad96424785ddaeccd: Status 404 returned error can't find the container with id 20b5aeb5b4a8105b4f18b616e035b0ebf3263c591256fc8ad96424785ddaeccd Jul 05 20:11:52.562777 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:52.562739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" event={"ID":"1eccad33-03a6-4cbf-9947-cd8c0a2e182f","Type":"ContainerStarted","Data":"10f4fc4395a3a55984686fae5fbb938cb2d5842eb5082a2271612765861576f1"} Jul 05 20:11:52.562947 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:52.562800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" event={"ID":"1eccad33-03a6-4cbf-9947-cd8c0a2e182f","Type":"ContainerStarted","Data":"20b5aeb5b4a8105b4f18b616e035b0ebf3263c591256fc8ad96424785ddaeccd"} Jul 05 20:11:52.562947 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:52.562828 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:52.581781 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:52.579118 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" podStartSLOduration=1.5790896129999998 podStartE2EDuration="1.579089613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 20:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:11:52.57563022 +0000 UTC m=+2511.202818672" watchObservedRunningTime="2026-07-05 20:11:52.579089613 +0000 UTC m=+2511.206278065" Jul 05 20:11:53.392062 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:53.392010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4rgc_3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6/dns/0.log" Jul 05 20:11:53.409904 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:53.409869 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4rgc_3c7fbaad-e1cc-41f7-ad82-8a6c50f944d6/kube-rbac-proxy/0.log" Jul 05 20:11:53.451307 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:53.451279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrb5s_5a45373c-bccf-4ed7-9d15-b1df4935fa2c/dns-node-resolver/0.log" Jul 05 20:11:54.001882 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:54.001849 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wzf9_125ebdae-6bea-43a9-863d-065316cb1f3f/node-ca/0.log" Jul 05 20:11:54.894788 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:54.894759 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678v97tf_b8fd4f69-fd56-4e8b-b61e-5c0816874317/istio-proxy/0.log" Jul 05 20:11:55.080034 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:55.079990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7j7rz_0a75cee0-2ca4-4fca-8086-732e5469454c/discovery/0.log" Jul 05 20:11:55.147077 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:55.146960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/0.log" Jul 05 20:11:55.201396 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:55.201364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/1.log" Jul 05 20:11:55.974182 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:55.974135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7mvv_b5d1c187-38e2-412b-aad6-6b5e6c9ed599/serve-healthcheck-canary/0.log" Jul 05 20:11:56.547888 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:56.547859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drfcn_af74b699-f048-4f84-a8f1-83b2ca4c2d3c/kube-rbac-proxy/0.log" Jul 05 20:11:56.571093 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:56.571068 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drfcn_af74b699-f048-4f84-a8f1-83b2ca4c2d3c/exporter/0.log" Jul 05 20:11:56.590974 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:56.590952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drfcn_af74b699-f048-4f84-a8f1-83b2ca4c2d3c/extractor/0.log" Jul 05 20:11:58.577972 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:58.576971 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-27wzv/perf-node-gather-daemonset-rvfld" Jul 05 20:11:59.204686 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:59.204657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68674bcb-6qhf5_5a8c0887-e702-48be-981c-7d7f17aeb0e1/manager/0.log" Jul 05 20:11:59.221895 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:11:59.221875 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68674bcb-6qhf5_5a8c0887-e702-48be-981c-7d7f17aeb0e1/copy-manifests/0.log" Jul 05 20:12:00.600517 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:00.600487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-db9cc5d86-d4xt2_3032558a-ce61-45c0-bfdb-5ad2a543d3fc/manager/0.log" Jul 05 20:12:00.650572 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:00.650542 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bms2f_7b0d32a3-f487-4a88-bf3d-e22c7a2a3cd2/openshift-lws-operator/0.log" Jul 05 20:12:01.872359 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:01.872331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678v97tf_b8fd4f69-fd56-4e8b-b61e-5c0816874317/istio-proxy/0.log" Jul 05 20:12:02.055769 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:02.055727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7j7rz_0a75cee0-2ca4-4fca-8086-732e5469454c/discovery/0.log" Jul 05 20:12:02.098553 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:02.098513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/0.log" Jul 05 20:12:02.153771 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:02.153687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/1.log" Jul 05 20:12:03.409306 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:03.409277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678v97tf_b8fd4f69-fd56-4e8b-b61e-5c0816874317/istio-proxy/0.log" Jul 05 20:12:03.599078 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:03.599012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7j7rz_0a75cee0-2ca4-4fca-8086-732e5469454c/discovery/0.log" Jul 05 20:12:03.646868 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:03.646804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/0.log" Jul 05 20:12:03.701600 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:03.701555 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6c57q_f13326e1-71de-41d4-b8a4-628c546081ea/istio-proxy/1.log" Jul 05 20:12:05.656358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:05.656326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-c96bn_8717e644-0993-4d0e-be39-a664ae84e368/migrator/0.log" Jul 05 20:12:05.674963 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:05.674938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-c96bn_8717e644-0993-4d0e-be39-a664ae84e368/graceful-termination/0.log" Jul 05 20:12:07.058046 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.058014 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/kube-multus-additional-cni-plugins/0.log" Jul 05 20:12:07.076936 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.076907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/egress-router-binary-copy/0.log" Jul 05 20:12:07.097884 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.097857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/cni-plugins/0.log" Jul 05 20:12:07.116154 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.116127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/bond-cni-plugin/0.log" Jul 05 20:12:07.133839 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.133818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/routeoverride-cni/0.log" Jul 05 20:12:07.151617 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.151587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/whereabouts-cni-bincopy/0.log" Jul 05 20:12:07.171020 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.170995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz2tx_83018d8d-1ebc-49ae-b28e-028e570dc010/whereabouts-cni/0.log" Jul 05 20:12:07.374228 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.374200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xtsvm_b15cf900-0d65-4321-ba9c-7a4d5496e200/kube-multus/0.log" Jul 05 20:12:07.434694 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.434670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-phtw8_d744635e-67c3-4f97-82c5-52cd1d516078/network-metrics-daemon/0.log" Jul 05 20:12:07.452118 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:07.452085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-phtw8_d744635e-67c3-4f97-82c5-52cd1d516078/kube-rbac-proxy/0.log" Jul 05 20:12:08.626655 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.626624 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/ovn-controller/0.log" Jul 05 20:12:08.641358 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.641326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/ovn-acl-logging/0.log" Jul 05 20:12:08.662717 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.662687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/kube-rbac-proxy-node/0.log" Jul 05 20:12:08.680772 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.680744 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/kube-rbac-proxy-ovn-metrics/0.log" Jul 05 20:12:08.696486 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.696453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/northd/0.log" Jul 05 20:12:08.715725 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.715707 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/nbdb/0.log" Jul 05 20:12:08.733095 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.733069 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/sbdb/0.log" Jul 05 20:12:08.803556 ip-10-0-142-62 kubenswrapper[2576]: I0705 20:12:08.803523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zb7hm_845245a7-1041-40f8-be6f-72eee8565ca0/ovnkube-controller/0.log"