Jul 08 03:17:54.554274 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 03:17:54.554286 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 03:17:54.554295 ip-10-0-140-212 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 03:17:54.554622 ip-10-0-140-212 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 03:18:04.793471 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 03:18:04.793492 ip-10-0-140-212 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ac59fe875d9748808b394049cac4cf40 -- Jul 08 03:20:09.361956 ip-10-0-140-212 systemd[1]: Starting Kubernetes Kubelet... Jul 08 03:20:09.737274 ip-10-0-140-212 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 03:20:09.737274 ip-10-0-140-212 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 03:20:09.737274 ip-10-0-140-212 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 03:20:09.737274 ip-10-0-140-212 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 03:20:09.737274 ip-10-0-140-212 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 03:20:09.739752 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.739654 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745544 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745565 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745569 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745572 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745575 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745578 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745581 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.745570 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745585 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745588 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745591 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745595 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745598 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745601 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745604 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745607 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745610 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745613 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745615 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745618 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745621 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745623 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745625 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745628 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745631 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745648 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745653 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.745870 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745656 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745659 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745662 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745665 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745667 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745670 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745672 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745675 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745677 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745680 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745682 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745685 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745687 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745690 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745692 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745695 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745697 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745700 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745703 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745705 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.746316 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745708 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745710 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745713 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745715 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745717 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745720 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745723 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745725 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745727 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745730 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745732 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745735 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745738 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745741 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745744 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745748 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745750 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745753 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745756 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745759 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.746861 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745761 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745763 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745767 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745771 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745774 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745777 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745779 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745782 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745785 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745788 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745790 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745793 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745796 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745798 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745803 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745807 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745810 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745814 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745817 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.747345 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745820 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745823 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745826 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745829 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745832 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745834 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745837 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745839 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745842 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745844 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745847 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745850 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745852 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.745855 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746610 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746618 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746623 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746626 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746629 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746653 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.747845 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746655 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746659 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746662 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746665 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746667 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746670 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746673 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746675 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746678 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746680 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746683 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746686 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746689 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746692 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746694 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746697 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746699 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746702 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746706 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.748342 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746709 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746712 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746715 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746718 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746721 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746724 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746727 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746730 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746733 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746735 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746738 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746741 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746743 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746746 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746748 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746751 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746753 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746756 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746758 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746761 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.748837 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746764 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746766 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746769 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746771 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746774 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746777 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746781 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746784 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746787 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746790 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746793 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746796 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746798 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746801 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746805 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746808 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746811 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746813 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746819 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746821 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.749327 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746824 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746826 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746829 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746832 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746834 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746837 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746840 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746842 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746845 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746847 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746850 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746853 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746855 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746857 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746862 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746866 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746870 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746872 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746875 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746878 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.749905 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746881 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746883 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746886 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746888 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746891 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746894 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746896 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746899 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746902 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746904 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746908 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746910 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746913 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.746915 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747309 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747314 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747317 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747320 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747322 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747325 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.750406 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747327 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747330 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747332 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747335 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747337 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747340 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747343 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747347 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747351 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747354 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747358 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747361 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747363 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747366 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747369 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747371 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747374 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747376 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747379 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.750906 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747384 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747386 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747389 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747392 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747394 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747397 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747399 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747402 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747404 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747407 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747409 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747412 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747414 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747417 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747420 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747422 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747425 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747427 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747430 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747432 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.751362 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747435 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747437 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747441 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747456 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747460 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747463 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747466 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747472 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747477 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747479 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747482 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747485 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747489 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747492 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747495 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747498 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747500 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747503 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747505 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747508 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.751931 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747511 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747513 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747515 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747518 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747523 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747526 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747528 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747530 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747533 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747535 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747538 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747540 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747543 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747545 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747548 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747550 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747553 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747556 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747558 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.752422 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747561 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747564 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747566 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747568 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747571 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747575 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747578 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747580 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747583 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747585 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747588 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747590 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747593 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747595 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.747598 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747689 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747696 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747703 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747707 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747711 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747714 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 03:20:09.752907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747719 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747723 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747726 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747729 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747733 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747737 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747740 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747743 2565 flags.go:64] FLAG: --cgroup-root="" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747746 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747749 2565 flags.go:64] FLAG: --client-ca-file="" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747752 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747755 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747758 2565 flags.go:64] FLAG: --cluster-domain="" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747762 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747765 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747768 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747773 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747777 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747780 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747783 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747786 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747789 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747792 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747795 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 03:20:09.753450 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747798 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747801 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747805 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747808 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747811 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747814 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747816 2565 flags.go:64] FLAG: --enable-server="true" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747819 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747824 2565 flags.go:64] FLAG: --event-burst="100" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747827 2565 flags.go:64] FLAG: --event-qps="50" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747829 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747833 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747835 2565 flags.go:64] FLAG: --eviction-hard="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747843 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747846 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747849 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747852 2565 flags.go:64] FLAG: --eviction-soft="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747855 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747859 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747869 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747874 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747877 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747881 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747884 2565 flags.go:64] FLAG: --feature-gates="" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747889 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 03:20:09.754033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747892 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747895 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747898 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747901 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747904 2565 flags.go:64] FLAG: --help="false" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747907 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-212.ec2.internal" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747910 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747913 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747915 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747918 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747921 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747924 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747927 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747929 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747932 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747935 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747938 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747940 2565 flags.go:64] FLAG: --kube-reserved="" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747943 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747946 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747950 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747953 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747956 2565 flags.go:64] FLAG: --lock-file="" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747958 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 03:20:09.754706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747962 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747965 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747970 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747973 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747975 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747978 2565 flags.go:64] FLAG: --logging-format="text" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747981 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747984 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747987 2565 flags.go:64] FLAG: --manifest-url="" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747990 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747994 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.747997 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748001 2565 flags.go:64] FLAG: --max-pods="110" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748004 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748007 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748010 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748012 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748015 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748019 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748022 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748029 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748032 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748035 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 03:20:09.755282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748038 2565 flags.go:64] FLAG: --pod-cidr="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748041 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748047 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748050 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748054 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748057 2565 flags.go:64] FLAG: --port="10250" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748060 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748063 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00bfba52c6f5bd49b" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748066 2565 flags.go:64] FLAG: --qos-reserved="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748069 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748072 2565 flags.go:64] FLAG: --register-node="true" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748075 2565 flags.go:64] FLAG: --register-with-taints="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748078 2565 flags.go:64] FLAG: --registry-burst="10" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748082 2565 flags.go:64] FLAG: --registry-qps="5" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748085 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748087 2565 flags.go:64] FLAG: --reserved-memory="" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748092 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748095 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748097 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748100 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748103 2565 flags.go:64] FLAG: --runonce="false" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748105 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748108 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748111 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748114 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 03:20:09.755881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748116 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748119 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748122 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748125 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748128 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748131 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748134 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748137 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748139 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748142 2565 flags.go:64] FLAG: --system-cgroups="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748145 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748151 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748156 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748158 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748163 2565 flags.go:64] FLAG: --tls-min-version="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748165 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748168 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748171 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748174 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748176 2565 flags.go:64] FLAG: --v="2" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748180 2565 flags.go:64] FLAG: --version="false" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748184 2565 flags.go:64] FLAG: --vmodule="" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748188 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748191 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748316 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.756504 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748320 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748323 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748325 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748328 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748330 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748333 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748336 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748338 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748341 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748343 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748346 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748349 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748353 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748357 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748360 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748363 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748366 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748368 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748370 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748375 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.757170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748378 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748381 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748384 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748387 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748389 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748392 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748394 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748397 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748400 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748402 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748405 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748408 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748411 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748413 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748416 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748419 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748421 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748424 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748426 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748429 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.757670 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748431 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748434 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748436 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748439 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748441 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748444 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748446 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748449 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748451 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748454 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748456 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748460 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748463 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748466 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748469 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748473 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748476 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748479 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748481 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748484 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.758164 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748487 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748489 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748492 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748495 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748497 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748500 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748503 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748505 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748508 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748510 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748513 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748515 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748518 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748520 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748523 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748525 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748528 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748532 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748535 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.758655 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748538 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748540 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748543 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748545 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748551 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748554 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748559 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748561 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748564 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748567 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748569 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748572 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748574 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748577 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748579 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748582 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748585 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748587 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.759115 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.748589 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.748600 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.756428 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.756450 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.757313 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.757323 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757388 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757394 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757398 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757402 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757405 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757408 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757411 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757414 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757416 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.759553 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757419 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757422 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757424 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757427 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757429 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757432 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757434 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757438 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757443 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757446 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757449 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757452 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757455 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757458 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757461 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757463 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757467 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757470 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757472 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.759964 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757476 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757480 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757483 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757486 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757488 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757491 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757493 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757496 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757498 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757501 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757503 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757507 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757509 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757513 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757517 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757519 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757522 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757525 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757527 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757530 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.760419 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757532 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757535 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757537 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757540 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757542 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757545 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757547 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757550 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757552 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757556 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757558 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757561 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757563 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757567 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757570 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757572 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757575 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757577 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757580 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757582 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.761041 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757585 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757587 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757589 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757592 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757595 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757597 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757599 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757602 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757604 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757606 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757609 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757611 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757613 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757617 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757619 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757623 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757626 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757629 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757647 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.761527 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757650 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757653 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757656 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757659 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757662 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757664 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757668 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757671 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757674 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757677 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757680 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757683 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.757689 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757809 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757815 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 03:20:09.761995 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757818 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757821 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757824 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757826 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757829 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757831 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757836 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757840 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757842 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757845 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757848 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757850 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757853 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757855 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757858 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757860 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757863 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757865 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757868 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 03:20:09.762358 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757870 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757873 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757876 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757878 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757881 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757884 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757887 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757890 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757894 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757897 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757900 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757903 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757906 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757909 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757911 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757914 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757916 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757918 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757921 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757924 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 03:20:09.762819 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757926 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757928 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757931 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757933 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757936 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757939 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757942 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757944 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757947 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757949 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757952 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757954 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757956 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757959 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757962 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757965 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757968 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757971 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757973 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757976 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 03:20:09.763299 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757979 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757981 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757983 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757986 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757988 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757991 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757993 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757995 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.757998 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758000 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758003 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758008 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758010 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758012 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758015 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758017 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758020 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758022 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758024 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 03:20:09.763802 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758027 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758029 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758032 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758034 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758037 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758040 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758042 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758044 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758047 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758050 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758052 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758054 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758057 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758060 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758062 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758065 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758067 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 03:20:09.764291 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:09.758070 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.758075 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.758217 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.760830 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.762169 2565 server.go:1019] "Starting client certificate rotation" Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.762280 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.762896 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 03:20:09.764782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.764537 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 03:20:09.770730 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.770673 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 03:20:09.779257 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.779236 2565 log.go:25] "Validated CRI v1 runtime API" Jul 08 03:20:09.782491 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.782473 2565 log.go:25] "Validated CRI v1 image API" Jul 08 03:20:09.784694 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.784661 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 03:20:09.787549 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.787521 2565 fs.go:135] Filesystem UUIDs: map[33f85e81-e038-45a0-aedb-c1931a241b21:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d447254e-a584-4a41-8593-31ad06c8cb6b:/dev/nvme0n1p3] Jul 08 03:20:09.787630 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.787548 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 03:20:09.792445 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.792328 2565 manager.go:216] Machine: {Timestamp:2026-07-08 03:20:09.791225675 +0000 UTC m=+0.316803789 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097029 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e6a588d1f3fe55623f31595fec44 SystemUUID:ec24e6a5-88d1-f3fe-5562-3f31595fec44 BootID:ac59fe87-5d97-4880-8b39-4049cac4cf40 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:37:66:8f:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:37:66:8f:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:c4:30:fc:f7:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 03:20:09.792445 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.792435 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 03:20:09.792622 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.792523 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 03:20:09.794481 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.794461 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 03:20:09.795188 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.795157 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 03:20:09.795336 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.795193 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 03:20:09.796454 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.796442 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 03:20:09.796497 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.796455 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 03:20:09.796497 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.796468 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 03:20:09.797531 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.797519 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 03:20:09.799301 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.799290 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 03:20:09.802547 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802535 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 08 03:20:09.802699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802689 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 03:20:09.802739 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802721 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 08 03:20:09.802739 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802731 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 03:20:09.802792 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802744 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 03:20:09.802792 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802754 2565 kubelet.go:398] "Adding apiserver pod source" Jul 08 03:20:09.802792 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.802764 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 03:20:09.803177 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.803164 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 03:20:09.803285 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.803182 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 03:20:09.805416 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.805389 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 03:20:09.807554 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.807540 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 03:20:09.807604 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.807571 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 03:20:09.808954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808942 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808959 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808964 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808969 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808978 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808983 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808991 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.808996 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 03:20:09.808999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809002 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 03:20:09.809202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809008 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 03:20:09.809202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809016 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 03:20:09.809202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809022 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 03:20:09.809681 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809672 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 03:20:09.809681 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.809681 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 03:20:09.813105 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.813089 2565 server.go:1268] "Started kubelet" Jul 08 03:20:09.813589 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.813539 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 03:20:09.813701 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.813168 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 03:20:09.813701 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.813654 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 03:20:09.814377 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.814353 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 03:20:09.814463 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.814394 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 03:20:09.814375 ip-10-0-140-212 systemd[1]: Started Kubernetes Kubelet. Jul 08 03:20:09.814601 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.814484 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 03:20:09.815795 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.815776 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 03:20:09.817039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.816942 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 08 03:20:09.819928 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.819903 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8twvv" Jul 08 03:20:09.820049 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.820013 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 03:20:09.822806 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.821846 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-212.ec2.internal.18c03258e4a22f78 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-212.ec2.internal,UID:ip-10-0-140-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-212.ec2.internal,},FirstTimestamp:2026-07-08 03:20:09.813061496 +0000 UTC m=+0.338639608,LastTimestamp:2026-07-08 03:20:09.813061496 +0000 UTC m=+0.338639608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-212.ec2.internal,}" Jul 08 03:20:09.825025 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825010 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 03:20:09.825099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825074 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 03:20:09.825270 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.825255 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:09.825740 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825624 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 03:20:09.825740 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825657 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 03:20:09.825740 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825673 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 03:20:09.825740 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825728 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 08 03:20:09.825740 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825738 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 08 03:20:09.826011 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825941 2565 factory.go:55] Registering systemd factory Jul 08 03:20:09.826011 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.825957 2565 factory.go:223] Registration of the systemd container factory successfully Jul 08 03:20:09.826362 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.826350 2565 factory.go:153] Registering CRI-O factory Jul 08 03:20:09.826362 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.826363 2565 factory.go:223] Registration of the crio container factory successfully Jul 08 03:20:09.826446 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.826411 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 03:20:09.826446 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.826432 2565 factory.go:103] Registering Raw factory Jul 08 03:20:09.826446 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.826447 2565 manager.go:1196] Started watching for new ooms in manager Jul 08 03:20:09.828218 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.827076 2565 manager.go:349] Starting recovery of all containers Jul 08 03:20:09.828218 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.828120 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8twvv" Jul 08 03:20:09.829826 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.829799 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 03:20:09.830081 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.830049 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 03:20:09.837461 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.837439 2565 manager.go:354] Recovery completed Jul 08 03:20:09.838588 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.838566 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 03:20:09.841719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.841703 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:09.844010 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.843986 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:09.844109 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.844031 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:09.844109 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.844049 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:09.845007 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.844990 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 03:20:09.845007 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.845006 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 03:20:09.845127 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.845029 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 08 03:20:09.845127 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.845086 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:09.845987 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.845970 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:09.846077 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.846004 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:09.846077 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.846019 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:09.846751 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.846738 2565 policy_none.go:49] "None policy: Start" Jul 08 03:20:09.846812 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.846762 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 03:20:09.846812 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.846773 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 03:20:09.847869 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.847852 2565 policy_none.go:47] "Start" Jul 08 03:20:09.883353 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883331 2565 manager.go:337] "Starting Device Plugin manager" Jul 08 03:20:09.883477 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.883367 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 03:20:09.883477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883377 2565 server.go:87] "Starting device plugin registration server" Jul 08 03:20:09.883790 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883775 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 03:20:09.883888 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883792 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 03:20:09.883935 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883902 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 03:20:09.884015 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.883999 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 03:20:09.884015 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.884011 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 03:20:09.884612 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.884593 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 03:20:09.884709 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.884672 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:09.984080 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.984044 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:09.985458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.985062 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:09.985458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.985094 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:09.985458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.985109 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:09.985458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.985137 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-212.ec2.internal" Jul 08 03:20:09.993222 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:09.993168 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-212.ec2.internal" Jul 08 03:20:09.993222 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:09.993198 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-212.ec2.internal\": node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.004650 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.004599 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.014071 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.014030 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 03:20:10.015443 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.015419 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 03:20:10.015550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.015457 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 03:20:10.015550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.015480 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 03:20:10.015550 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.015520 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 03:20:10.018266 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.018249 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 03:20:10.105325 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.105267 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.116464 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.116430 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"] Jul 08 03:20:10.116572 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.116518 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:10.117531 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.117514 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:10.117624 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.117548 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:10.117624 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.117564 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:10.118808 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.118792 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:10.118909 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.118891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.118976 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.118926 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:10.119571 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119556 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:10.119682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119587 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:10.119682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119602 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:10.119682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119612 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:10.119682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119652 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:10.119682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.119669 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:10.120842 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.120825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.120927 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.120857 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 03:20:10.121557 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.121543 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory" Jul 08 03:20:10.121614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.121571 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 03:20:10.121614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.121580 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID" Jul 08 03:20:10.126899 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.126882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.126958 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.126905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c149f1b9c7b961c6631e65b97b735994-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"c149f1b9c7b961c6631e65b97b735994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.126958 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.126923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.149674 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.149627 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-212.ec2.internal\" not found" node="ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.154264 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.154246 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-212.ec2.internal\" not found" node="ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.205419 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.205393 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.227910 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.227878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c149f1b9c7b961c6631e65b97b735994-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"c149f1b9c7b961c6631e65b97b735994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.227999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.227914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.227999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.227941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.227999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.227990 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.228104 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.228008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc626e7f36f669b8a5848eb74340d0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"5dc626e7f36f669b8a5848eb74340d0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.228104 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.227991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c149f1b9c7b961c6631e65b97b735994-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"c149f1b9c7b961c6631e65b97b735994\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.306406 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.306328 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.406894 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.406853 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.453379 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.453348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.458421 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.458403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:10.507720 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.507685 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.608673 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.608613 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.715211 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.715174 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.761677 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.761626 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 03:20:10.762276 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.761828 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 03:20:10.815614 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.815569 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:10.830688 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.830582 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 03:15:10 +0000 UTC" deadline="2028-04-05 21:55:49.883075336 +0000 UTC" Jul 08 03:20:10.830688 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:10.830617 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15306h35m39.052462144s" Jul 08 03:20:10.916805 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:10.916760 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:11.018306 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.018268 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found" Jul 08 03:20:11.029442 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.029415 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 03:20:11.040281 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:11.040247 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc149f1b9c7b961c6631e65b97b735994.slice/crio-5b39cecf32d66d31fd675afcb9e33792e62c67ec7e33143a6fc83e98cc9b7f57 WatchSource:0}: Error finding container 5b39cecf32d66d31fd675afcb9e33792e62c67ec7e33143a6fc83e98cc9b7f57: Status 404 returned error can't find the container with id 5b39cecf32d66d31fd675afcb9e33792e62c67ec7e33143a6fc83e98cc9b7f57 Jul 08 03:20:11.040873 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:11.040848 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc626e7f36f669b8a5848eb74340d0d.slice/crio-a8eda1d148362ae3855398b47637dac24724aead4c12fcf8666cc34a582be134 WatchSource:0}: Error finding container a8eda1d148362ae3855398b47637dac24724aead4c12fcf8666cc34a582be134: Status 404 returned error can't find the container with id a8eda1d148362ae3855398b47637dac24724aead4c12fcf8666cc34a582be134 Jul 08 03:20:11.042877 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.042857 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 03:20:11.045787 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.045770 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 03:20:11.068459 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.068422 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 03:20:11.126244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.126170 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" Jul 08 03:20:11.137244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.137214 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 03:20:11.138236 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.138221 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" Jul 08 03:20:11.148541 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.148515 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 03:20:11.803834 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.803774 2565 apiserver.go:52] "Watching apiserver" Jul 08 03:20:11.813362 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.813322 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 03:20:11.815151 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.815105 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2vhbf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal","openshift-multus/multus-additional-cni-plugins-htkbm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd","openshift-multus/multus-pg4p5","openshift-multus/network-metrics-daemon-vzzs4","openshift-network-diagnostics/network-check-target-kkq65","openshift-network-operator/iptables-alerter-2r7cs","openshift-ovn-kubernetes/ovnkube-node-jvcm9","kube-system/global-pull-secret-syncer-csbvt","kube-system/konnectivity-agent-vp52s","kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7pr72","openshift-dns/node-resolver-vpbnb"] Jul 08 03:20:11.817372 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.817348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:11.817497 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.817438 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:11.819042 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.819019 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.824082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.824054 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.824228 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.824088 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.824329 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.824313 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5j9m7\"" Jul 08 03:20:11.824329 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.824317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.825899 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.825877 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 03:20:11.826069 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.825987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.826642 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.826621 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.826973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.826951 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 03:20:11.827056 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.827020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kjxsp\"" Jul 08 03:20:11.827148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.827122 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 03:20:11.827215 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.827161 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 03:20:11.827272 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.827218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.828254 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.828234 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 03:20:11.828348 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.828272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.828674 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.828653 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.828764 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.828697 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g2rp7\"" Jul 08 03:20:11.829303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.829137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.829600 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.829577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:11.829918 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.829730 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:11.830517 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.830497 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 03:20:11.831004 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.830981 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kjj22\"" Jul 08 03:20:11.831445 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.831161 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.834057 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.834034 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 03:20:11.835200 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.834314 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.835200 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.835087 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 03:20:11.837196 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.836146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nls8h\"" Jul 08 03:20:11.838378 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.837415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 03:20:11.838378 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.837475 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.838378 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-socket-dir-parent\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-netns\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-multus-certs\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmgkb\" (UniqueName: \"kubernetes.io/projected/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-kube-api-access-zmgkb\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.838993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-kubernetes\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-var-lib-kubelet\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-host\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-k8s-cni-cncf-io\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-modprobe-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-lib-modules\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-tmp\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-os-release\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-daemon-config\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cnibin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.839643 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-bin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-kubelet\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-systemd\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.839827 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nznw\" (UniqueName: \"kubernetes.io/projected/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-kube-api-access-6nznw\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-sys-fs\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.839996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-multus\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-etc-kubernetes\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkhv\" (UniqueName: \"kubernetes.io/projected/c025bab1-988b-432b-8b59-892a73070ff0-kube-api-access-8mkhv\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-socket-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-device-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.840906 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-run\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-system-cni-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840605 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-conf-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-registration-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8q2\" (UniqueName: \"kubernetes.io/projected/f5334bfa-c9ba-4404-b101-c2edc45b2861-kube-api-access-zz8q2\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cni-binary-copy\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-hostroot\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysconfig\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840877 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.840978 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zhvw9\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841447 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-etc-selinux\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841738 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9nbsk\"" Jul 08 03:20:11.841902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-system-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.841948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-conf\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-sys\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-etc-tuned\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cnibin\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-os-release\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.844066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.842798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:11.845614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.845466 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 03:20:11.845614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.845525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 03:20:11.845614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.845586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8kctr\"" Jul 08 03:20:11.846695 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.846110 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:11.847222 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.847121 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.848748 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.848592 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 03:20:11.848748 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.848620 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 03:20:11.849141 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.848908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 03:20:11.849141 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.849012 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rnds2\"" Jul 08 03:20:11.860922 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.860886 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvx9n" Jul 08 03:20:11.869485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.869149 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvx9n" Jul 08 03:20:11.927075 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.927050 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 03:20:11.942760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d70a16-5e41-441d-8c80-5fe3ea688cab-host-slash\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-systemd-units\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41bf7d5c-469c-4421-b943-93eed6810d58-host\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-conf\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8q2\" (UniqueName: \"kubernetes.io/projected/f5334bfa-c9ba-4404-b101-c2edc45b2861-kube-api-access-zz8q2\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.942936 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cni-binary-copy\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-slash\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.942992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-systemd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-hosts-file\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-etc-tuned\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cnibin\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nznw\" (UniqueName: \"kubernetes.io/projected/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-kube-api-access-6nznw\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-os-release\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-var-lib-kubelet\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-env-overrides\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-lib-modules\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-os-release\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.943251 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-script-lib\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cnibin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-kubelet\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-kubelet-config\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-config\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41bf7d5c-469c-4421-b943-93eed6810d58-serviceca\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-tmp-dir\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-sys-fs\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-multus\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-etc-kubernetes\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-etc-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdqh\" (UniqueName: \"kubernetes.io/projected/41bf7d5c-469c-4421-b943-93eed6810d58-kube-api-access-xwdqh\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-konnectivity-ca\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-socket-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-device-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.943981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-system-cni-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9nr6\" (UniqueName: \"kubernetes.io/projected/819ff2bb-b65b-41d6-abba-86ff5e0b189d-kube-api-access-d9nr6\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-sys\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-conf-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-registration-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-hostroot\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysconfig\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943748 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-etc-selinux\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-system-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9477\" (UniqueName: \"kubernetes.io/projected/73d70a16-5e41-441d-8c80-5fe3ea688cab-kube-api-access-h9477\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-socket-dir-parent\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.943962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-os-release\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cnibin\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.944700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-socket-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944252 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-sys-fs\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944319 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-multus\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-device-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-etc-kubernetes\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-system-cni-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-registration-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-hostroot\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-conf-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysconfig\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-sys\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-conf\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-kubelet\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-netns\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-multus-certs\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944829 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-etc-selinux\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.945344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmgkb\" (UniqueName: \"kubernetes.io/projected/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-kube-api-access-zmgkb\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-var-lib-kubelet\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-kubernetes\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-os-release\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-host\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944906 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cnibin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-multus-certs\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-socket-dir-parent\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-kubernetes\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-host\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-tmp\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945120 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-lib-modules\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-k8s-cni-cncf-io\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-netns\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-modprobe-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.946074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-agent-certs\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-modprobe-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945350 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-run-k8s-cni-cncf-io\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-kubelet\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-cni-binary-copy\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.944833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-system-cni-dir\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-netns\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-ovn\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-netd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-daemon-config\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-bin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-host-var-lib-cni-bin\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-systemd\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkhv\" (UniqueName: \"kubernetes.io/projected/c025bab1-988b-432b-8b59-892a73070ff0-kube-api-access-8mkhv\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.945944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d70a16-5e41-441d-8c80-5fe3ea688cab-iptables-alerter-script\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-var-lib-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-log-socket\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4f9v\" (UniqueName: \"kubernetes.io/projected/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-kube-api-access-r4f9v\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-multus-daemon-config\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9kp\" (UniqueName: \"kubernetes.io/projected/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-kube-api-access-dg9kp\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-node-log\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f5334bfa-c9ba-4404-b101-c2edc45b2861-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-bin\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-systemd\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-run\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-dbus\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-run\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946667 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.947972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.946929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c025bab1-988b-432b-8b59-892a73070ff0-etc-sysctl-d\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.949406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.949373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-etc-tuned\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.949527 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.949406 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c025bab1-988b-432b-8b59-892a73070ff0-tmp\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.952290 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.951921 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:11.952290 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.951951 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:11.952290 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.951965 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:11.952290 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:11.952068 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:12.452011758 +0000 UTC m=+2.977589895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:11.960488 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.955214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nznw\" (UniqueName: \"kubernetes.io/projected/35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f-kube-api-access-6nznw\") pod \"multus-additional-cni-plugins-htkbm\" (UID: \"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f\") " pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:11.960488 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.960257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkhv\" (UniqueName: \"kubernetes.io/projected/c025bab1-988b-432b-8b59-892a73070ff0-kube-api-access-8mkhv\") pod \"tuned-7pr72\" (UID: \"c025bab1-988b-432b-8b59-892a73070ff0\") " pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:11.960876 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.960851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8q2\" (UniqueName: \"kubernetes.io/projected/f5334bfa-c9ba-4404-b101-c2edc45b2861-kube-api-access-zz8q2\") pod \"aws-ebs-csi-driver-node-z74cd\" (UID: \"f5334bfa-c9ba-4404-b101-c2edc45b2861\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:11.961239 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.961214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmgkb\" (UniqueName: \"kubernetes.io/projected/9b4921f6-8955-48ed-95bf-aaa79cd44fa7-kube-api-access-zmgkb\") pod \"multus-pg4p5\" (UID: \"9b4921f6-8955-48ed-95bf-aaa79cd44fa7\") " pod="openshift-multus/multus-pg4p5" Jul 08 03:20:11.963049 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:11.962818 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 03:20:12.023358 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.023283 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"5dc626e7f36f669b8a5848eb74340d0d","Type":"ContainerStarted","Data":"a8eda1d148362ae3855398b47637dac24724aead4c12fcf8666cc34a582be134"} Jul 08 03:20:12.025155 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.025123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" event={"ID":"c149f1b9c7b961c6631e65b97b735994","Type":"ContainerStarted","Data":"5b39cecf32d66d31fd675afcb9e33792e62c67ec7e33143a6fc83e98cc9b7f57"} Jul 08 03:20:12.046818 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d70a16-5e41-441d-8c80-5fe3ea688cab-iptables-alerter-script\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-var-lib-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-log-socket\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4f9v\" (UniqueName: \"kubernetes.io/projected/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-kube-api-access-r4f9v\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9kp\" (UniqueName: \"kubernetes.io/projected/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-kube-api-access-dg9kp\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-node-log\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.046991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.046978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-bin\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-dbus\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d70a16-5e41-441d-8c80-5fe3ea688cab-host-slash\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-systemd-units\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41bf7d5c-469c-4421-b943-93eed6810d58-host\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-slash\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-systemd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-hosts-file\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-env-overrides\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-script-lib\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-kubelet-config\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-config\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41bf7d5c-469c-4421-b943-93eed6810d58-serviceca\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.047364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-tmp-dir\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-etc-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdqh\" (UniqueName: \"kubernetes.io/projected/41bf7d5c-469c-4421-b943-93eed6810d58-kube-api-access-xwdqh\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-konnectivity-ca\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9nr6\" (UniqueName: \"kubernetes.io/projected/819ff2bb-b65b-41d6-abba-86ff5e0b189d-kube-api-access-d9nr6\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9477\" (UniqueName: \"kubernetes.io/projected/73d70a16-5e41-441d-8c80-5fe3ea688cab-kube-api-access-h9477\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-agent-certs\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-kubelet\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-netns\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-ovn\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-netd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.047946 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-netd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-kubelet-config\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d70a16-5e41-441d-8c80-5fe3ea688cab-iptables-alerter-script\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-var-lib-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-log-socket\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-config\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048772 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-node-log\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-cni-bin\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.048961 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048930 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93ea0bd5-e962-49e5-8322-aed707e94ec0-dbus\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.048975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d70a16-5e41-441d-8c80-5fe3ea688cab-host-slash\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049021 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-systemd-units\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41bf7d5c-469c-4421-b943-93eed6810d58-host\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-slash\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-systemd\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.049352 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41bf7d5c-469c-4421-b943-93eed6810d58-serviceca\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.049652 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049470 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-tmp-dir\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.049652 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-etc-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.049652 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049572 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-env-overrides\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.049652 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.049640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-hosts-file\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.049940 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.049747 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:12.049940 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.049851 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:12.549810891 +0000 UTC m=+3.075389014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:12.050523 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.050496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-konnectivity-ca\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:12.050610 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.050553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-kubelet\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.050660 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.050620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-netns\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.050696 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.050668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-ovn\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.050778 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.050755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.051222 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.051197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/819ff2bb-b65b-41d6-abba-86ff5e0b189d-run-openvswitch\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.051310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.051274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovnkube-script-lib\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.051379 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.051358 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:12.051483 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.051469 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:12.551403757 +0000 UTC m=+3.076981878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:12.053977 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.053879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/819ff2bb-b65b-41d6-abba-86ff5e0b189d-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.053977 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.053897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18bfbd1e-d404-4f91-a3c5-9de2118d0f40-agent-certs\") pod \"konnectivity-agent-vp52s\" (UID: \"18bfbd1e-d404-4f91-a3c5-9de2118d0f40\") " pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:12.064343 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.064308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9kp\" (UniqueName: \"kubernetes.io/projected/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-kube-api-access-dg9kp\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:12.065756 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.065619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9477\" (UniqueName: \"kubernetes.io/projected/73d70a16-5e41-441d-8c80-5fe3ea688cab-kube-api-access-h9477\") pod \"iptables-alerter-2r7cs\" (UID: \"73d70a16-5e41-441d-8c80-5fe3ea688cab\") " pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.066588 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.066563 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdqh\" (UniqueName: \"kubernetes.io/projected/41bf7d5c-469c-4421-b943-93eed6810d58-kube-api-access-xwdqh\") pod \"node-ca-2vhbf\" (UID: \"41bf7d5c-469c-4421-b943-93eed6810d58\") " pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.067119 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.067097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9nr6\" (UniqueName: \"kubernetes.io/projected/819ff2bb-b65b-41d6-abba-86ff5e0b189d-kube-api-access-d9nr6\") pod \"ovnkube-node-jvcm9\" (UID: \"819ff2bb-b65b-41d6-abba-86ff5e0b189d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.068571 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.068549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4f9v\" (UniqueName: \"kubernetes.io/projected/87e9e6fb-7821-44c4-aa84-1b6df40c9d23-kube-api-access-r4f9v\") pod \"node-resolver-vpbnb\" (UID: \"87e9e6fb-7821-44c4-aa84-1b6df40c9d23\") " pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.137809 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.137765 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7pr72" Jul 08 03:20:12.146681 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.146621 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc025bab1_988b_432b_8b59_892a73070ff0.slice/crio-0975b21522e73a7d9f190111bf235dfda0e605f42a30f9e858b4e8ef22d6acf1 WatchSource:0}: Error finding container 0975b21522e73a7d9f190111bf235dfda0e605f42a30f9e858b4e8ef22d6acf1: Status 404 returned error can't find the container with id 0975b21522e73a7d9f190111bf235dfda0e605f42a30f9e858b4e8ef22d6acf1 Jul 08 03:20:12.150875 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.150854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htkbm" Jul 08 03:20:12.158750 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.158723 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a8a8a2_5fc9_40ee_a5fd_158261cf1c1f.slice/crio-27aef7fc64c9f4d2dddb958dd4bfa61e5542fc3fb9354fbe0b7d537a7363282c WatchSource:0}: Error finding container 27aef7fc64c9f4d2dddb958dd4bfa61e5542fc3fb9354fbe0b7d537a7363282c: Status 404 returned error can't find the container with id 27aef7fc64c9f4d2dddb958dd4bfa61e5542fc3fb9354fbe0b7d537a7363282c Jul 08 03:20:12.162069 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.162011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" Jul 08 03:20:12.170137 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.170106 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5334bfa_c9ba_4404_b101_c2edc45b2861.slice/crio-5286ef2953cd811815bd8cc9778efdef7a836b9983db6b4a7b885d98cc733ba6 WatchSource:0}: Error finding container 5286ef2953cd811815bd8cc9778efdef7a836b9983db6b4a7b885d98cc733ba6: Status 404 returned error can't find the container with id 5286ef2953cd811815bd8cc9778efdef7a836b9983db6b4a7b885d98cc733ba6 Jul 08 03:20:12.170823 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.170795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pg4p5" Jul 08 03:20:12.180214 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.180189 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4921f6_8955_48ed_95bf_aaa79cd44fa7.slice/crio-d3526463102b525184d901608d4a3b78d031c938b210431407cf77a8e60c8978 WatchSource:0}: Error finding container d3526463102b525184d901608d4a3b78d031c938b210431407cf77a8e60c8978: Status 404 returned error can't find the container with id d3526463102b525184d901608d4a3b78d031c938b210431407cf77a8e60c8978 Jul 08 03:20:12.180878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.180858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:12.190310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.190282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2vhbf" Jul 08 03:20:12.191019 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.190980 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819ff2bb_b65b_41d6_abba_86ff5e0b189d.slice/crio-adcf3441f74dcb8f04d7c3da344b6b5fb5d5e09fc5e6bd227738907bad6e8434 WatchSource:0}: Error finding container adcf3441f74dcb8f04d7c3da344b6b5fb5d5e09fc5e6bd227738907bad6e8434: Status 404 returned error can't find the container with id adcf3441f74dcb8f04d7c3da344b6b5fb5d5e09fc5e6bd227738907bad6e8434 Jul 08 03:20:12.200400 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.200367 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41bf7d5c_469c_4421_b943_93eed6810d58.slice/crio-d4b563f2c03cd311e3f3ed9aff86fcd39da3bc4ff3a1726a2675b8bb7c0ab91c WatchSource:0}: Error finding container d4b563f2c03cd311e3f3ed9aff86fcd39da3bc4ff3a1726a2675b8bb7c0ab91c: Status 404 returned error can't find the container with id d4b563f2c03cd311e3f3ed9aff86fcd39da3bc4ff3a1726a2675b8bb7c0ab91c Jul 08 03:20:12.201052 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.201030 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpbnb" Jul 08 03:20:12.209126 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.209095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:12.213408 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.213379 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e9e6fb_7821_44c4_aa84_1b6df40c9d23.slice/crio-b1dd87d17e769771512cc3c2c1a35c1febca597e96d903ed748dad6122a522be WatchSource:0}: Error finding container b1dd87d17e769771512cc3c2c1a35c1febca597e96d903ed748dad6122a522be: Status 404 returned error can't find the container with id b1dd87d17e769771512cc3c2c1a35c1febca597e96d903ed748dad6122a522be Jul 08 03:20:12.219598 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.219570 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bfbd1e_d404_4f91_a3c5_9de2118d0f40.slice/crio-d288fbef3a5b213425ff01d1072a1c93cd8f45a683c2e1e05180588618f5d347 WatchSource:0}: Error finding container d288fbef3a5b213425ff01d1072a1c93cd8f45a683c2e1e05180588618f5d347: Status 404 returned error can't find the container with id d288fbef3a5b213425ff01d1072a1c93cd8f45a683c2e1e05180588618f5d347 Jul 08 03:20:12.226449 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.226413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2r7cs" Jul 08 03:20:12.238595 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:12.238561 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d70a16_5e41_441d_8c80_5fe3ea688cab.slice/crio-32a01ca4c422fa734b993e2f65e009b0315d9e57b34b1a331fabfa04432610dd WatchSource:0}: Error finding container 32a01ca4c422fa734b993e2f65e009b0315d9e57b34b1a331fabfa04432610dd: Status 404 returned error can't find the container with id 32a01ca4c422fa734b993e2f65e009b0315d9e57b34b1a331fabfa04432610dd Jul 08 03:20:12.551616 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.551581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.551628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.551668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551752 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551756 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551775 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551796 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:12.551801 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551804 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:13.55179106 +0000 UTC m=+4.077369162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:12.552045 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551809 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:12.552045 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551818 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:13.551810778 +0000 UTC m=+4.077388879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:12.552045 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:12.551845 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:13.55183223 +0000 UTC m=+4.077410331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:12.872203 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.872086 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 03:15:12 +0000 UTC" deadline="2028-01-19 22:46:14.164896094 +0000 UTC" Jul 08 03:20:12.872203 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:12.872129 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h26m1.292771685s" Jul 08 03:20:13.015938 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.015893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:13.016141 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.016057 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:13.029702 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.029655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerStarted","Data":"27aef7fc64c9f4d2dddb958dd4bfa61e5542fc3fb9354fbe0b7d537a7363282c"} Jul 08 03:20:13.031125 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.031046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp52s" event={"ID":"18bfbd1e-d404-4f91-a3c5-9de2118d0f40","Type":"ContainerStarted","Data":"d288fbef3a5b213425ff01d1072a1c93cd8f45a683c2e1e05180588618f5d347"} Jul 08 03:20:13.032287 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.032228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpbnb" event={"ID":"87e9e6fb-7821-44c4-aa84-1b6df40c9d23","Type":"ContainerStarted","Data":"b1dd87d17e769771512cc3c2c1a35c1febca597e96d903ed748dad6122a522be"} Jul 08 03:20:13.034007 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.033899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"adcf3441f74dcb8f04d7c3da344b6b5fb5d5e09fc5e6bd227738907bad6e8434"} Jul 08 03:20:13.036512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.036464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pg4p5" event={"ID":"9b4921f6-8955-48ed-95bf-aaa79cd44fa7","Type":"ContainerStarted","Data":"d3526463102b525184d901608d4a3b78d031c938b210431407cf77a8e60c8978"} Jul 08 03:20:13.038162 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.038103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7pr72" event={"ID":"c025bab1-988b-432b-8b59-892a73070ff0","Type":"ContainerStarted","Data":"0975b21522e73a7d9f190111bf235dfda0e605f42a30f9e858b4e8ef22d6acf1"} Jul 08 03:20:13.039903 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.039856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2r7cs" event={"ID":"73d70a16-5e41-441d-8c80-5fe3ea688cab","Type":"ContainerStarted","Data":"32a01ca4c422fa734b993e2f65e009b0315d9e57b34b1a331fabfa04432610dd"} Jul 08 03:20:13.043361 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.043296 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2vhbf" event={"ID":"41bf7d5c-469c-4421-b943-93eed6810d58","Type":"ContainerStarted","Data":"d4b563f2c03cd311e3f3ed9aff86fcd39da3bc4ff3a1726a2675b8bb7c0ab91c"} Jul 08 03:20:13.046788 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.046700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" event={"ID":"f5334bfa-c9ba-4404-b101-c2edc45b2861","Type":"ContainerStarted","Data":"5286ef2953cd811815bd8cc9778efdef7a836b9983db6b4a7b885d98cc733ba6"} Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.558991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.559055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.559100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559264 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559288 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559302 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559367 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:15.559345863 +0000 UTC m=+6.084923967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559804 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559858 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:15.559841196 +0000 UTC m=+6.085419305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559921 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:13.559994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:13.559954 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:15.559942189 +0000 UTC m=+6.085520294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:13.872924 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.872792 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 03:15:12 +0000 UTC" deadline="2028-04-08 02:08:44.946713242 +0000 UTC" Jul 08 03:20:13.872924 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:13.872872 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15358h48m31.073846708s" Jul 08 03:20:14.016179 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:14.016133 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:14.016327 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:14.016287 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:14.016757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:14.016738 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:14.016872 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:14.016851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:15.016793 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.015886 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:15.016793 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.016302 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:15.055973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.055932 2565 generic.go:356] "Generic (PLEG): container finished" podID="5dc626e7f36f669b8a5848eb74340d0d" containerID="43fad37f60840e83ed5870deadd35b99ff3c15b5e7ff7ca23005ccafcc3b2bc9" exitCode=0 Jul 08 03:20:15.056200 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.056033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"5dc626e7f36f669b8a5848eb74340d0d","Type":"ContainerDied","Data":"43fad37f60840e83ed5870deadd35b99ff3c15b5e7ff7ca23005ccafcc3b2bc9"} Jul 08 03:20:15.064561 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.064508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" event={"ID":"c149f1b9c7b961c6631e65b97b735994","Type":"ContainerStarted","Data":"2caf98a4b7b4d00ae3097fb5afcb78b2a2abf3bea38bc2029c1ebdf63e5c934b"} Jul 08 03:20:15.088041 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.087218 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" podStartSLOduration=4.087196438 podStartE2EDuration="4.087196438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:15.086599265 +0000 UTC m=+5.612177394" watchObservedRunningTime="2026-07-08 03:20:15.087196438 +0000 UTC m=+5.612774566" Jul 08 03:20:15.579318 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.579261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:15.579513 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.579353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:15.579513 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:15.579400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:15.579642 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579589 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579666 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:19.579645525 +0000 UTC m=+10.105223633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579806 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579833 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579851 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579866 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579869 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:19.579851877 +0000 UTC m=+10.105429997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:15.579974 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:15.579906 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:19.579894703 +0000 UTC m=+10.105472828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:16.016775 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:16.016668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:16.016956 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:16.016836 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:16.016956 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:16.016864 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:16.017385 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:16.016976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:17.015896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:17.015861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:17.016070 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:17.016024 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:18.016261 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:18.016231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:18.016261 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:18.016255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:18.016677 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:18.016364 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:18.016758 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:18.016729 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:19.016015 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:19.015919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:19.016190 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.016052 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:19.610791 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:19.610757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:19.610812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:19.610851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.610914 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.610959 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.610971 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.610981 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:27.61096762 +0000 UTC m=+18.136545719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.610992 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.611004 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.611013 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:27.610999857 +0000 UTC m=+18.136577956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:19.611231 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:19.611053 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:27.61104006 +0000 UTC m=+18.136618165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:20.017189 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:20.017114 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:20.017321 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:20.017224 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:20.017766 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:20.017612 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:20.017766 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:20.017721 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:21.016185 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:21.015755 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:21.016185 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:21.015886 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:22.016341 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:22.016305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:22.016341 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:22.016305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:22.016760 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:22.016430 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:22.016760 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:22.016509 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:23.016170 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:23.016131 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:23.016365 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:23.016267 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:24.016757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:24.016461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:24.016757 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:24.016601 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:24.017311 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:24.016867 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:24.017311 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:24.016988 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:25.015726 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:25.015689 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:25.015915 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:25.015807 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:26.016350 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:26.016304 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:26.016830 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:26.016455 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:26.016830 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:26.016511 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:26.016830 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:26.016628 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:27.016541 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:27.016496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:27.017077 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.016651 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:27.670206 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:27.670164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:27.670400 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:27.670228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:27.670400 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:27.670267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:27.670400 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670362 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:27.670400 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670379 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670381 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670431 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:20:43.670417518 +0000 UTC m=+34.195995619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670447 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:43.670438678 +0000 UTC m=+34.196016779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670449 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670474 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:27.670587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:27.670532 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:20:43.670515095 +0000 UTC m=+34.196093198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:28.016287 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:28.016198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:28.016287 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:28.016251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:28.016510 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:28.016349 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:28.016510 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:28.016451 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:29.016052 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:29.016026 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:29.016587 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:29.016123 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:30.016604 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:30.016568 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:30.017049 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:30.016737 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:30.017049 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:30.016796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:30.017049 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:30.016891 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:31.016230 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:31.016192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:31.016419 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:31.016330 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:32.019248 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.019030 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:32.019734 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:32.019351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:32.019734 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.019517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:32.019734 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:32.019695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:32.111196 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.110181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp52s" event={"ID":"18bfbd1e-d404-4f91-a3c5-9de2118d0f40","Type":"ContainerStarted","Data":"812282bb81699ea04d39bfb96ea49834d2075513b7f363b7c66c1975c8371dab"} Jul 08 03:20:32.114532 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.114332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpbnb" event={"ID":"87e9e6fb-7821-44c4-aa84-1b6df40c9d23","Type":"ContainerStarted","Data":"a7de232fc5a1a124928c690fbaac1ce393b28e74fa207c99f0fd7435ab2131c3"} Jul 08 03:20:32.117620 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.117254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"9d6f6e51deba79759a49beee6b3a0defba14b822ca76226e2c439d11b4f34234"} Jul 08 03:20:32.117620 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.117316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"514a32c25ffa549e2af181a1e1ff504c64938a1ff177b01748cc72f009b31ee3"} Jul 08 03:20:32.120139 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.119831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pg4p5" event={"ID":"9b4921f6-8955-48ed-95bf-aaa79cd44fa7","Type":"ContainerStarted","Data":"d80b172b5bb3f06b7e8810badd1c2c98a357c9f963cf622805b5fcce0f7ec68d"} Jul 08 03:20:32.121870 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.121834 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7pr72" event={"ID":"c025bab1-988b-432b-8b59-892a73070ff0","Type":"ContainerStarted","Data":"ab8b03312a9a77a8ee40735d0d0514ae7c009489cf8846c31be44e7ad7941ff5"} Jul 08 03:20:32.124675 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.124623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"5dc626e7f36f669b8a5848eb74340d0d","Type":"ContainerStarted","Data":"5e71e5089e00260c6bf2f73c74e128242959e5acfcb3137d1c56dc78c6b16282"} Jul 08 03:20:32.128881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.128164 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vp52s" podStartSLOduration=2.561271693 podStartE2EDuration="22.12814743s" totalImagesPullingTime="19.566875737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.126372842 +0000 UTC m=+22.651950967" watchObservedRunningTime="2026-07-08 03:20:32.12814743 +0000 UTC m=+22.653725551" Jul 08 03:20:32.128881 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.128557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2vhbf" event={"ID":"41bf7d5c-469c-4421-b943-93eed6810d58","Type":"ContainerStarted","Data":"9e863955db69423509c65b90d8446683551fda551b559b59bbb999bd4d4dd2ca"} Jul 08 03:20:32.134024 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.133992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" event={"ID":"f5334bfa-c9ba-4404-b101-c2edc45b2861","Type":"ContainerStarted","Data":"1b61057c451ba8b547ee6282da06925a0de16bc0992d3f353dd12d7084a47787"} Jul 08 03:20:32.136015 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.135878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerStarted","Data":"eaa0afab9104eefa72c5f50aa034628dd3fffeee9c1364522d6ab4addceb2e21"} Jul 08 03:20:32.146515 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.146452 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pg4p5" podStartSLOduration=2.429830906 podStartE2EDuration="22.146436773s" totalImagesPullingTime="19.716605867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.14629514 +0000 UTC m=+22.671873262" watchObservedRunningTime="2026-07-08 03:20:32.146436773 +0000 UTC m=+22.672014894" Jul 08 03:20:32.160903 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.160855 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" podStartSLOduration=21.160839523 podStartE2EDuration="21.160839523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.160382274 +0000 UTC m=+22.685960397" watchObservedRunningTime="2026-07-08 03:20:32.160839523 +0000 UTC m=+22.686417644" Jul 08 03:20:32.176365 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.176290 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7pr72" podStartSLOduration=2.487940999 podStartE2EDuration="22.17626705s" totalImagesPullingTime="19.688326051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.176162643 +0000 UTC m=+22.701740766" watchObservedRunningTime="2026-07-08 03:20:32.17626705 +0000 UTC m=+22.701845164" Jul 08 03:20:32.190354 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.190301 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vpbnb" podStartSLOduration=2.617912509 podStartE2EDuration="22.190285254s" totalImagesPullingTime="19.572372745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.189776064 +0000 UTC m=+22.715354186" watchObservedRunningTime="2026-07-08 03:20:32.190285254 +0000 UTC m=+22.715863376" Jul 08 03:20:32.210808 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:32.210761 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2vhbf" podStartSLOduration=11.06700554 podStartE2EDuration="22.210744831s" totalImagesPullingTime="11.143739291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:32.21025842 +0000 UTC m=+22.735836542" watchObservedRunningTime="2026-07-08 03:20:32.210744831 +0000 UTC m=+22.736322980" Jul 08 03:20:33.016246 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.016212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:33.016406 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:33.016349 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:33.139582 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.139501 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="eaa0afab9104eefa72c5f50aa034628dd3fffeee9c1364522d6ab4addceb2e21" exitCode=0 Jul 08 03:20:33.140439 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.139589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"eaa0afab9104eefa72c5f50aa034628dd3fffeee9c1364522d6ab4addceb2e21"} Jul 08 03:20:33.142766 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.142737 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"f74ddadddbcca3cc0b672ee552316c684992ed9225deffe6b334c0ccb070783e"} Jul 08 03:20:33.142876 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.142827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"fb6849fed700139485c2373c92eadb0ef6795ddff146fef4b57b4983499d0dbd"} Jul 08 03:20:33.142916 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.142875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"93b8bafa3c7bb372384dd9f2bb039fa051fbb6407c899bdc6dd119bffd6b93ff"} Jul 08 03:20:33.142948 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.142921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"07e5b8ec1e84ddcd60d097ead48da11c9d669d6baf5f95688305127e2ed7c53b"} Jul 08 03:20:33.144222 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.144187 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2r7cs" event={"ID":"73d70a16-5e41-441d-8c80-5fe3ea688cab","Type":"ContainerStarted","Data":"5dd514adb3312e8a397223df597068409e06bbd0d6356d13eea609e6e6d97aa8"} Jul 08 03:20:33.591577 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.591543 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 03:20:33.901491 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.901359 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T03:20:33.59156332Z","UUID":"d9cc1a29-17df-476a-b879-eea39e029993","Handler":null,"Name":"","Endpoint":""} Jul 08 03:20:33.902730 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.902706 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 03:20:33.902850 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:33.902744 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 03:20:34.018264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:34.016613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:34.018264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:34.016664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:34.018264 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:34.016773 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:34.018264 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:34.016907 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:34.149543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:34.149499 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" event={"ID":"f5334bfa-c9ba-4404-b101-c2edc45b2861","Type":"ContainerStarted","Data":"fc1183244417d30961ec217ace7b2492bf6c461c40844d5463fa786df52d428e"} Jul 08 03:20:35.015959 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.015732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:35.016127 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:35.016059 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:35.154406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.154366 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" event={"ID":"f5334bfa-c9ba-4404-b101-c2edc45b2861","Type":"ContainerStarted","Data":"0d09effc2f0dcbd1096622adb459217476de32794fdd6e374b7f03c10e82f010"} Jul 08 03:20:35.158195 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.158157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"4d2e4adb1b15980f1c8a93064a257e292789a578b87a936005f2d4b1bb839728"} Jul 08 03:20:35.161176 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.161116 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:35.161731 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.161709 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:35.171512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.171463 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z74cd" podStartSLOduration=2.777960364 podStartE2EDuration="25.171449105s" totalImagesPullingTime="22.393488741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:35.17113814 +0000 UTC m=+25.696716264" watchObservedRunningTime="2026-07-08 03:20:35.171449105 +0000 UTC m=+25.697027226" Jul 08 03:20:35.171762 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:35.171738 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2r7cs" podStartSLOduration=5.583111361 podStartE2EDuration="25.171727941s" totalImagesPullingTime="19.58861658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:33.1753128 +0000 UTC m=+23.700890919" watchObservedRunningTime="2026-07-08 03:20:35.171727941 +0000 UTC m=+25.697306063" Jul 08 03:20:36.020926 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:36.020887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:36.021160 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:36.021015 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:36.021160 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:36.021062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:36.021160 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:36.021148 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:36.160300 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:36.160260 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:36.160872 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:36.160622 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vp52s" Jul 08 03:20:37.015700 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:37.015667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:37.015878 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:37.015778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:38.019390 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:38.019313 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:38.019927 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:38.019485 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:38.019927 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:38.019537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:38.019927 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:38.019689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:39.016406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.016162 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:39.016560 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:39.016435 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:39.168818 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.168783 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="7bedca12a367c6c816990ee4fd9a79d09f79854cac5bc16dfeb4af9caa164c6c" exitCode=0 Jul 08 03:20:39.169543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.168851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"7bedca12a367c6c816990ee4fd9a79d09f79854cac5bc16dfeb4af9caa164c6c"} Jul 08 03:20:39.172852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.172827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" event={"ID":"819ff2bb-b65b-41d6-abba-86ff5e0b189d","Type":"ContainerStarted","Data":"68b8cda00061b2f8f1fe10ca3c01a5f8f5fd070c9183b200dec010021918ca39"} Jul 08 03:20:39.173294 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.173150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:39.173294 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.173215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:39.173294 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.173250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:39.189543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.189516 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:39.189742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.189627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:20:39.218471 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:39.218411 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" podStartSLOduration=9.507421478 podStartE2EDuration="29.21839404s" totalImagesPullingTime="19.710972562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:39.218214704 +0000 UTC m=+29.743792826" watchObservedRunningTime="2026-07-08 03:20:39.21839404 +0000 UTC m=+29.743972162" Jul 08 03:20:40.020123 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.020089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:40.020323 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:40.020183 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:40.020323 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.020235 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:40.020411 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:40.020367 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:40.304390 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.304222 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kkq65"] Jul 08 03:20:40.304809 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.304476 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:40.304809 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:40.304563 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:40.308068 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.307663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csbvt"] Jul 08 03:20:40.308068 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.307774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:40.308068 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:40.307881 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:40.308430 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.308406 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzzs4"] Jul 08 03:20:40.308512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:40.308500 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:40.308650 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:40.308613 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:41.178939 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:41.178845 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="a2e2cc67b4b2bea316b57ce1686b0478bb09050bba17031a7195c18217ffab92" exitCode=0 Jul 08 03:20:41.178939 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:41.178926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"a2e2cc67b4b2bea316b57ce1686b0478bb09050bba17031a7195c18217ffab92"} Jul 08 03:20:42.019152 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:42.019122 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:42.019689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:42.019211 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:42.019689 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:42.019220 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:42.019689 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:42.019295 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:42.019689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:42.019303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:42.019689 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:42.019388 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:43.185280 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:43.185243 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="8580945cd1ddbcb73b66f9105389b098a8b21bbcd4274f83f8bedc0b44764444" exitCode=0 Jul 08 03:20:43.185280 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:43.185280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"8580945cd1ddbcb73b66f9105389b098a8b21bbcd4274f83f8bedc0b44764444"} Jul 08 03:20:43.689043 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:43.688985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:43.689058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:43.689096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689141 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689150 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689171 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689181 2565 projected.go:196] Error preparing data for projected volume kube-api-access-79hcr for pod openshift-network-diagnostics/network-check-target-kkq65: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689187 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689203 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret podName:93ea0bd5-e962-49e5-8322-aed707e94ec0 nodeName:}" failed. No retries permitted until 2026-07-08 03:21:15.689189731 +0000 UTC m=+66.214767830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret") pod "global-pull-secret-syncer-csbvt" (UID: "93ea0bd5-e962-49e5-8322-aed707e94ec0") : object "kube-system"/"original-pull-secret" not registered Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689222 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr podName:9a0a2212-3595-4de6-86ef-8347ef84cb65 nodeName:}" failed. No retries permitted until 2026-07-08 03:21:15.689210405 +0000 UTC m=+66.214788505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-79hcr" (UniqueName: "kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr") pod "network-check-target-kkq65" (UID: "9a0a2212-3595-4de6-86ef-8347ef84cb65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 03:20:43.689238 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:43.689237 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:21:15.689230858 +0000 UTC m=+66.214808957 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 03:20:44.016216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.016135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:44.016365 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.016135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:44.016365 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:44.016253 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csbvt" podUID="93ea0bd5-e962-49e5-8322-aed707e94ec0" Jul 08 03:20:44.016365 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.016137 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:44.016365 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:44.016327 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:20:44.016513 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:44.016399 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kkq65" podUID="9a0a2212-3595-4de6-86ef-8347ef84cb65" Jul 08 03:20:44.771596 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.771526 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeReady" Jul 08 03:20:44.771979 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.771672 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 03:20:44.817784 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.817747 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfsb5"] Jul 08 03:20:44.826160 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.826131 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tft8h"] Jul 08 03:20:44.826295 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.826263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.828549 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.828528 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjrkj\"" Jul 08 03:20:44.828688 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.828563 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 03:20:44.828863 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.828846 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 03:20:44.831327 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.831305 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfsb5"] Jul 08 03:20:44.831442 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.831394 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:44.833907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.833889 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v57gq\"" Jul 08 03:20:44.834028 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.833952 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 03:20:44.834101 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.834049 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 03:20:44.835146 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.834346 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 03:20:44.835791 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.835772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tft8h"] Jul 08 03:20:44.898208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.898175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-tmp-dir\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.898382 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.898214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2xq\" (UniqueName: \"kubernetes.io/projected/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-kube-api-access-lk2xq\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.898382 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.898243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.898382 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.898329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-config-volume\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.999237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-tmp-dir\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.999237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2xq\" (UniqueName: \"kubernetes.io/projected/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-kube-api-access-lk2xq\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.999477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.999477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-config-volume\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:44.999477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d7e2eb-d73a-4aed-91d4-449a3db96494-cert\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:44.999477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8t6\" (UniqueName: \"kubernetes.io/projected/e3d7e2eb-d73a-4aed-91d4-449a3db96494-kube-api-access-2w8t6\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:44.999477 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:44.999442 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:20:44.999625 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:44.999520 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:20:45.499498206 +0000 UTC m=+36.025076305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:20:44.999625 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-tmp-dir\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:45.000001 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:44.999971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-config-volume\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:45.010629 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.010597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2xq\" (UniqueName: \"kubernetes.io/projected/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-kube-api-access-lk2xq\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:45.100272 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.100178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d7e2eb-d73a-4aed-91d4-449a3db96494-cert\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:45.100272 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.100221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8t6\" (UniqueName: \"kubernetes.io/projected/e3d7e2eb-d73a-4aed-91d4-449a3db96494-kube-api-access-2w8t6\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:45.102775 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.102747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d7e2eb-d73a-4aed-91d4-449a3db96494-cert\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:45.109366 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.109341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8t6\" (UniqueName: \"kubernetes.io/projected/e3d7e2eb-d73a-4aed-91d4-449a3db96494-kube-api-access-2w8t6\") pod \"ingress-canary-tft8h\" (UID: \"e3d7e2eb-d73a-4aed-91d4-449a3db96494\") " pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:45.143527 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.143493 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tft8h" Jul 08 03:20:45.296621 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.296366 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tft8h"] Jul 08 03:20:45.300533 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:20:45.300505 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d7e2eb_d73a_4aed_91d4_449a3db96494.slice/crio-892b7bceb3a93ea96e6f86141e0a340d84ee3fce26a2ea1350fa352f61387037 WatchSource:0}: Error finding container 892b7bceb3a93ea96e6f86141e0a340d84ee3fce26a2ea1350fa352f61387037: Status 404 returned error can't find the container with id 892b7bceb3a93ea96e6f86141e0a340d84ee3fce26a2ea1350fa352f61387037 Jul 08 03:20:45.503549 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:45.503507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:45.503732 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:45.503682 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:20:45.503769 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:45.503750 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:20:46.503732431 +0000 UTC m=+37.029310530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:20:46.016356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.016323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:20:46.016356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.016344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:20:46.016998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.016484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:20:46.019793 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.019773 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 03:20:46.021029 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.020508 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 03:20:46.021029 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.020535 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zb8ld\"" Jul 08 03:20:46.021029 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.020553 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 03:20:46.021029 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.020702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 03:20:46.021029 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.020835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2m54\"" Jul 08 03:20:46.197120 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.197056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tft8h" event={"ID":"e3d7e2eb-d73a-4aed-91d4-449a3db96494","Type":"ContainerStarted","Data":"892b7bceb3a93ea96e6f86141e0a340d84ee3fce26a2ea1350fa352f61387037"} Jul 08 03:20:46.512690 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:46.512616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:46.512964 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:46.512806 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:20:46.512964 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:46.512888 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:20:48.51286984 +0000 UTC m=+39.038447939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:20:48.528401 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:48.528358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:48.528960 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:48.528550 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:20:48.528960 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:48.528623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:20:52.528602386 +0000 UTC m=+43.054180486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:20:49.209308 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:49.209275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerStarted","Data":"a173cdb1f96d3964095339fdd2da1fb1e2b6bba0c2b130fd25aea5a55b1ab5cc"} Jul 08 03:20:49.210954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:49.210919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tft8h" event={"ID":"e3d7e2eb-d73a-4aed-91d4-449a3db96494","Type":"ContainerStarted","Data":"b6d9fc0d1eee1149f9fad209d830e2277c061bfd8ab065387d8627b34fdaa9d3"} Jul 08 03:20:49.251197 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:49.251132 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tft8h" podStartSLOduration=1.548326504 podStartE2EDuration="5.251106799s" totalImagesPullingTime="3.702780295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:49.250309789 +0000 UTC m=+39.775887913" watchObservedRunningTime="2026-07-08 03:20:49.251106799 +0000 UTC m=+39.776684922" Jul 08 03:20:50.215289 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:50.215199 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="a173cdb1f96d3964095339fdd2da1fb1e2b6bba0c2b130fd25aea5a55b1ab5cc" exitCode=0 Jul 08 03:20:50.215731 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:50.215284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"a173cdb1f96d3964095339fdd2da1fb1e2b6bba0c2b130fd25aea5a55b1ab5cc"} Jul 08 03:20:51.220919 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:51.220875 2565 generic.go:356] "Generic (PLEG): container finished" podID="35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f" containerID="805b48a5d0942fe1710906778832ed8b615f5aa523dbaa9ff129d2f6a0a0febb" exitCode=0 Jul 08 03:20:51.221318 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:51.220955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerDied","Data":"805b48a5d0942fe1710906778832ed8b615f5aa523dbaa9ff129d2f6a0a0febb"} Jul 08 03:20:52.225911 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:52.225878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htkbm" event={"ID":"35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f","Type":"ContainerStarted","Data":"6bf0d2c46e7c8f50d6ed3df26dabc4cf0896b1b5a0498586122d7c919bf6a921"} Jul 08 03:20:52.249786 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:52.249731 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htkbm" podStartSLOduration=8.924620707 podStartE2EDuration="42.24971534s" totalImagesPullingTime="33.325094633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:52.248252314 +0000 UTC m=+42.773830437" watchObservedRunningTime="2026-07-08 03:20:52.24971534 +0000 UTC m=+42.775293543" Jul 08 03:20:52.554922 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:20:52.554829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:20:52.555070 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:52.554990 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:20:52.555070 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:20:52.555059 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:21:00.555041061 +0000 UTC m=+51.080619162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:21:00.613828 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:00.613787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:21:00.614245 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:00.613940 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:21:00.614245 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:00.614002 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:21:16.613986111 +0000 UTC m=+67.139564213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:21:11.196559 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:11.196533 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcm9" Jul 08 03:21:15.716371 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.716312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:21:15.716371 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.716377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:21:15.716887 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.716405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:21:15.719585 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.719564 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 03:21:15.719675 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.719600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 03:21:15.719784 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.719765 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 03:21:15.726994 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:15.726971 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 03:21:15.727121 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:15.727063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:22:19.727040013 +0000 UTC m=+130.252618125 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : secret "metrics-daemon-secret" not found Jul 08 03:21:15.729199 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.729184 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 03:21:15.730465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.730443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93ea0bd5-e962-49e5-8322-aed707e94ec0-original-pull-secret\") pod \"global-pull-secret-syncer-csbvt\" (UID: \"93ea0bd5-e962-49e5-8322-aed707e94ec0\") " pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:21:15.736154 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.736133 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csbvt" Jul 08 03:21:15.739987 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.739595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79hcr\" (UniqueName: \"kubernetes.io/projected/9a0a2212-3595-4de6-86ef-8347ef84cb65-kube-api-access-79hcr\") pod \"network-check-target-kkq65\" (UID: \"9a0a2212-3595-4de6-86ef-8347ef84cb65\") " pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:21:15.863093 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:15.863059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csbvt"] Jul 08 03:21:15.866209 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:21:15.866176 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ea0bd5_e962_49e5_8322_aed707e94ec0.slice/crio-4c05f795bf58938162bf67c6d79a3e4ac28513dc1485cbde2c2f67770af06efc WatchSource:0}: Error finding container 4c05f795bf58938162bf67c6d79a3e4ac28513dc1485cbde2c2f67770af06efc: Status 404 returned error can't find the container with id 4c05f795bf58938162bf67c6d79a3e4ac28513dc1485cbde2c2f67770af06efc Jul 08 03:21:16.033067 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.032983 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2m54\"" Jul 08 03:21:16.040338 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.040316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:21:16.166089 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.166058 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kkq65"] Jul 08 03:21:16.169313 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:21:16.169283 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0a2212_3595_4de6_86ef_8347ef84cb65.slice/crio-b3de4abe5a9b14ac1171c628cd2f9cca12d0422286c1806a09c7b27524d742ee WatchSource:0}: Error finding container b3de4abe5a9b14ac1171c628cd2f9cca12d0422286c1806a09c7b27524d742ee: Status 404 returned error can't find the container with id b3de4abe5a9b14ac1171c628cd2f9cca12d0422286c1806a09c7b27524d742ee Jul 08 03:21:16.282012 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.281973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kkq65" event={"ID":"9a0a2212-3595-4de6-86ef-8347ef84cb65","Type":"ContainerStarted","Data":"b3de4abe5a9b14ac1171c628cd2f9cca12d0422286c1806a09c7b27524d742ee"} Jul 08 03:21:16.283065 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.283042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csbvt" event={"ID":"93ea0bd5-e962-49e5-8322-aed707e94ec0","Type":"ContainerStarted","Data":"4c05f795bf58938162bf67c6d79a3e4ac28513dc1485cbde2c2f67770af06efc"} Jul 08 03:21:16.621466 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:16.621425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:21:16.621668 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:16.621575 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:21:16.621668 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:16.621666 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:21:48.621624414 +0000 UTC m=+99.147202518 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:21:21.298323 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:21.298280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csbvt" event={"ID":"93ea0bd5-e962-49e5-8322-aed707e94ec0","Type":"ContainerStarted","Data":"56cbf8b2d37e9f87f6abe38935bcf97a00bc61e776dfc62d34663f94416c0058"} Jul 08 03:21:21.299669 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:21.299647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kkq65" event={"ID":"9a0a2212-3595-4de6-86ef-8347ef84cb65","Type":"ContainerStarted","Data":"48af9626ff3f56bf41432f658449131fa4def54ac5b3e0652efbfc36c5a49580"} Jul 08 03:21:21.299780 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:21.299767 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:21:21.314822 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:21.314771 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-csbvt" podStartSLOduration=66.327497223 podStartE2EDuration="1m11.314756487s" totalImagesPullingTime="4.987259264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:21:21.313931674 +0000 UTC m=+71.839509811" watchObservedRunningTime="2026-07-08 03:21:21.314756487 +0000 UTC m=+71.840334608" Jul 08 03:21:23.960984 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.960931 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kkq65" podStartSLOduration=69.277224293 podStartE2EDuration="1m13.960913075s" totalImagesPullingTime="4.683688782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:21:21.32838264 +0000 UTC m=+71.853960763" watchObservedRunningTime="2026-07-08 03:21:23.960913075 +0000 UTC m=+74.486491262" Jul 08 03:21:23.961475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.961109 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb"] Jul 08 03:21:23.986949 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.986919 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq"] Jul 08 03:21:23.987112 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.987056 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:23.989935 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.989907 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 03:21:23.990082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.990020 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 03:21:23.990082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.990071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 03:21:23.990218 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:23.990194 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 03:21:24.000488 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.000460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb"] Jul 08 03:21:24.000609 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.000499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq"] Jul 08 03:21:24.000609 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.000596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.004172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.003878 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 03:21:24.005178 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.004493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 03:21:24.005178 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.004820 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 03:21:24.005178 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.005075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 03:21:24.070109 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.070109 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4c7\" (UniqueName: \"kubernetes.io/projected/6e9ed805-d24a-4778-9f41-ff82975a892c-kube-api-access-dh4c7\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9ed805-d24a-4778-9f41-ff82975a892c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899952e1-b23f-4c80-908f-6ba745163d72-tmp\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/899952e1-b23f-4c80-908f-6ba745163d72-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5f7\" (UniqueName: \"kubernetes.io/projected/899952e1-b23f-4c80-908f-6ba745163d72-kube-api-access-qm5f7\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.070346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.070307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.170782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.170746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5f7\" (UniqueName: \"kubernetes.io/projected/899952e1-b23f-4c80-908f-6ba745163d72-kube-api-access-qm5f7\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.170782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.170785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.170993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171075 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4c7\" (UniqueName: \"kubernetes.io/projected/6e9ed805-d24a-4778-9f41-ff82975a892c-kube-api-access-dh4c7\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171121 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9ed805-d24a-4778-9f41-ff82975a892c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171121 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899952e1-b23f-4c80-908f-6ba745163d72-tmp\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.171216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/899952e1-b23f-4c80-908f-6ba745163d72-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.171337 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171549 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899952e1-b23f-4c80-908f-6ba745163d72-tmp\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.171680 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.171929 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.171909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9ed805-d24a-4778-9f41-ff82975a892c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.173731 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.173698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.173951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.173928 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.174236 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.174213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-ca\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.174364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.174350 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/899952e1-b23f-4c80-908f-6ba745163d72-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.174401 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.174380 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e9ed805-d24a-4778-9f41-ff82975a892c-hub\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.179931 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.179908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4c7\" (UniqueName: \"kubernetes.io/projected/6e9ed805-d24a-4778-9f41-ff82975a892c-kube-api-access-dh4c7\") pod \"cluster-proxy-proxy-agent-86d46ff747-xr5jq\" (UID: \"6e9ed805-d24a-4778-9f41-ff82975a892c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.180107 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.180089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5f7\" (UniqueName: \"kubernetes.io/projected/899952e1-b23f-4c80-908f-6ba745163d72-kube-api-access-qm5f7\") pod \"klusterlet-addon-workmgr-7c6cd64666-n55hb\" (UID: \"899952e1-b23f-4c80-908f-6ba745163d72\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.296354 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.296262 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:24.324192 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.324156 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:21:24.459527 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.459497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb"] Jul 08 03:21:24.463001 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:21:24.462973 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899952e1_b23f_4c80_908f_6ba745163d72.slice/crio-f3669f8fc6da2219e42d101acca7f9f8a12e7dcf7635edec7cd6107ec44678ec WatchSource:0}: Error finding container f3669f8fc6da2219e42d101acca7f9f8a12e7dcf7635edec7cd6107ec44678ec: Status 404 returned error can't find the container with id f3669f8fc6da2219e42d101acca7f9f8a12e7dcf7635edec7cd6107ec44678ec Jul 08 03:21:24.491997 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:24.491966 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq"] Jul 08 03:21:24.495357 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:21:24.495330 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e9ed805_d24a_4778_9f41_ff82975a892c.slice/crio-60148d160e61d7e5c38616175abdb83af6119551fe6996d55d17b2d28e259e6f WatchSource:0}: Error finding container 60148d160e61d7e5c38616175abdb83af6119551fe6996d55d17b2d28e259e6f: Status 404 returned error can't find the container with id 60148d160e61d7e5c38616175abdb83af6119551fe6996d55d17b2d28e259e6f Jul 08 03:21:25.314354 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:25.314308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" event={"ID":"899952e1-b23f-4c80-908f-6ba745163d72","Type":"ContainerStarted","Data":"f3669f8fc6da2219e42d101acca7f9f8a12e7dcf7635edec7cd6107ec44678ec"} Jul 08 03:21:25.316542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:25.316241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerStarted","Data":"60148d160e61d7e5c38616175abdb83af6119551fe6996d55d17b2d28e259e6f"} Jul 08 03:21:30.334736 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.334696 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" event={"ID":"899952e1-b23f-4c80-908f-6ba745163d72","Type":"ContainerStarted","Data":"b5ce6d689863c4b58dc52c1b4de9c5edc3cf4ad3fa2a73fc83b61bc2592e76cf"} Jul 08 03:21:30.335199 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.334888 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:30.336629 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.336605 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:21:30.336973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.336948 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerStarted","Data":"51515418c28e27111714b46312f3255421084075588e2c476bb87c82ff063e24"} Jul 08 03:21:30.337025 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.336986 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerStarted","Data":"a0f24abc2c8a87eb739d1dd83a325cf1b68d6f51579e0a0d24283e2e6391892e"} Jul 08 03:21:30.337025 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.337003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerStarted","Data":"942bb7670524e71c8a5299b61930acb7f204d9c8a09210228d166ee0cb172cc5"} Jul 08 03:21:30.352456 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.352407 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" podStartSLOduration=2.129472638 podStartE2EDuration="7.352391748s" totalImagesPullingTime="5.22291911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:21:30.35080362 +0000 UTC m=+80.876381745" watchObservedRunningTime="2026-07-08 03:21:30.352391748 +0000 UTC m=+80.877969869" Jul 08 03:21:30.387289 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:30.387237 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" podStartSLOduration=2.195545939 podStartE2EDuration="7.387219964s" totalImagesPullingTime="5.191674025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:21:30.386453896 +0000 UTC m=+80.912032018" watchObservedRunningTime="2026-07-08 03:21:30.387219964 +0000 UTC m=+80.912798085" Jul 08 03:21:48.660070 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:48.660009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:21:48.660571 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:48.660167 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:21:48.660571 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:21:48.660233 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:22:52.660216255 +0000 UTC m=+163.185794356 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:21:52.304496 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:21:52.304457 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kkq65" Jul 08 03:22:19.780047 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:22:19.780010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:22:19.780563 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:19.780125 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 03:22:19.780563 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:19.780179 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:24:21.780165232 +0000 UTC m=+252.305743332 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : secret "metrics-daemon-secret" not found Jul 08 03:22:47.838031 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:47.837976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfsb5" podUID="d58ee91a-c5a9-49e7-a0db-ab50732d9a3c" Jul 08 03:22:48.557303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:22:48.557272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:22:49.042171 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:49.042125 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:22:52.714005 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:22:52.713966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:22:52.714418 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:52.714089 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 03:22:52.714418 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:22:52.714143 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls podName:d58ee91a-c5a9-49e7-a0db-ab50732d9a3c nodeName:}" failed. No retries permitted until 2026-07-08 03:24:54.714128695 +0000 UTC m=+285.239706795 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls") pod "dns-default-hfsb5" (UID: "d58ee91a-c5a9-49e7-a0db-ab50732d9a3c") : secret "dns-default-metrics-tls" not found Jul 08 03:23:03.016298 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:03.016214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:23:30.335737 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:30.335682 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" podUID="899952e1-b23f-4c80-908f-6ba745163d72" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jul 08 03:23:30.682994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:30.682960 2565 generic.go:356] "Generic (PLEG): container finished" podID="899952e1-b23f-4c80-908f-6ba745163d72" containerID="b5ce6d689863c4b58dc52c1b4de9c5edc3cf4ad3fa2a73fc83b61bc2592e76cf" exitCode=1 Jul 08 03:23:30.683176 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:30.683032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" event={"ID":"899952e1-b23f-4c80-908f-6ba745163d72","Type":"ContainerDied","Data":"b5ce6d689863c4b58dc52c1b4de9c5edc3cf4ad3fa2a73fc83b61bc2592e76cf"} Jul 08 03:23:30.683364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:30.683349 2565 scope.go:117] "RemoveContainer" containerID="b5ce6d689863c4b58dc52c1b4de9c5edc3cf4ad3fa2a73fc83b61bc2592e76cf" Jul 08 03:23:31.687886 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:31.687848 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" event={"ID":"899952e1-b23f-4c80-908f-6ba745163d72","Type":"ContainerStarted","Data":"c903fbf8296766e92e17d9ac84961ffa1497c534c39003ed2e74ca4d0d3070e5"} Jul 08 03:23:31.688282 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:31.688120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:23:31.688743 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:23:31.688723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6cd64666-n55hb" Jul 08 03:24:18.205431 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.205397 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxwgk"] Jul 08 03:24:18.207571 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.207540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.210303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.210286 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 03:24:18.210790 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.210774 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 03:24:18.210913 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.210890 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 03:24:18.210999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.210973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kfwlq\"" Jul 08 03:24:18.211395 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.211376 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 03:24:18.219309 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.219287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxwgk"] Jul 08 03:24:18.312129 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.312084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc84f4a9-96d4-4788-b1f5-5343d2361603-crio-socket\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.312302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.312146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgm8x\" (UniqueName: \"kubernetes.io/projected/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-api-access-sgm8x\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.312302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.312196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.312302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.312218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.312453 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.312306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc84f4a9-96d4-4788-b1f5-5343d2361603-data-volume\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413484 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413484 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc84f4a9-96d4-4788-b1f5-5343d2361603-data-volume\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc84f4a9-96d4-4788-b1f5-5343d2361603-crio-socket\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.413575 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc84f4a9-96d4-4788-b1f5-5343d2361603-crio-socket\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.413610 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.413677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:18.913660214 +0000 UTC m=+249.439238314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : configmap "kube-rbac-proxy" not found Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgm8x\" (UniqueName: \"kubernetes.io/projected/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-api-access-sgm8x\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.413719 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.413707 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:18.913689951 +0000 UTC m=+249.439268050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : secret "insights-runtime-extractor-tls" not found Jul 08 03:24:18.413969 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.413916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc84f4a9-96d4-4788-b1f5-5343d2361603-data-volume\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.421876 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.421849 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgm8x\" (UniqueName: \"kubernetes.io/projected/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-api-access-sgm8x\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.917853 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.917809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.917853 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:18.917850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:18.918072 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.917949 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 03:24:18.918072 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.917964 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 03:24:18.918072 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.918026 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:19.918011935 +0000 UTC m=+250.443590035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : secret "insights-runtime-extractor-tls" not found Jul 08 03:24:18.918072 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:18.918039 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:19.918032178 +0000 UTC m=+250.443610278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : configmap "kube-rbac-proxy" not found Jul 08 03:24:19.925190 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:19.925145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:19.925190 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:19.925189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:19.925625 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:19.925271 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 03:24:19.925625 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:19.925312 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 03:24:19.925625 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:19.925343 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:21.925322162 +0000 UTC m=+252.450900264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : configmap "kube-rbac-proxy" not found Jul 08 03:24:19.925625 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:19.925359 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:21.925349453 +0000 UTC m=+252.450927554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : secret "insights-runtime-extractor-tls" not found Jul 08 03:24:21.186748 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:21.186720 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpbnb_87e9e6fb-7821-44c4-aa84-1b6df40c9d23/dns-node-resolver/0.log" Jul 08 03:24:21.786139 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:21.786114 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2vhbf_41bf7d5c-469c-4421-b943-93eed6810d58/node-ca/0.log" Jul 08 03:24:21.837239 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:21.837200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:24:21.837409 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.837312 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 03:24:21.837409 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.837366 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs podName:65ac74a9-81b4-499f-ad6c-9d9a4e72421f nodeName:}" failed. No retries permitted until 2026-07-08 03:26:23.837353091 +0000 UTC m=+374.362931191 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs") pod "network-metrics-daemon-vzzs4" (UID: "65ac74a9-81b4-499f-ad6c-9d9a4e72421f") : secret "metrics-daemon-secret" not found Jul 08 03:24:21.938250 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:21.938207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:21.938250 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:21.938241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:21.938439 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.938342 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 03:24:21.938439 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.938361 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 03:24:21.938439 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.938407 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:25.938390116 +0000 UTC m=+256.463968215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : configmap "kube-rbac-proxy" not found Jul 08 03:24:21.938439 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:21.938422 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:25.938416192 +0000 UTC m=+256.463994292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : secret "insights-runtime-extractor-tls" not found Jul 08 03:24:22.991699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:22.991665 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tft8h_e3d7e2eb-d73a-4aed-91d4-449a3db96494/serve-healthcheck-canary/0.log" Jul 08 03:24:25.964757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:25.964713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:25.964757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:25.964758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:25.965240 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:25.964844 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 03:24:25.965240 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:25.964907 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 03:24:25.965240 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:25.964914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:33.964898285 +0000 UTC m=+264.490476385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : configmap "kube-rbac-proxy" not found Jul 08 03:24:25.965240 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:25.964972 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls podName:fc84f4a9-96d4-4788-b1f5-5343d2361603 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:33.964955395 +0000 UTC m=+264.490533495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxwgk" (UID: "fc84f4a9-96d4-4788-b1f5-5343d2361603") : secret "insights-runtime-extractor-tls" not found Jul 08 03:24:34.023113 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.023033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:34.023113 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.023071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:34.023550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.023532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc84f4a9-96d4-4788-b1f5-5343d2361603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:34.025538 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.025517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc84f4a9-96d4-4788-b1f5-5343d2361603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxwgk\" (UID: \"fc84f4a9-96d4-4788-b1f5-5343d2361603\") " pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:34.116900 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.116863 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxwgk" Jul 08 03:24:34.305359 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.305270 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxwgk"] Jul 08 03:24:34.308226 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:24:34.308194 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc84f4a9_96d4_4788_b1f5_5343d2361603.slice/crio-4d0a6c5d35c7e2dd8b7ca8461e23d632f75d8d9eb3010e75f093e1b4db2c4e61 WatchSource:0}: Error finding container 4d0a6c5d35c7e2dd8b7ca8461e23d632f75d8d9eb3010e75f093e1b4db2c4e61: Status 404 returned error can't find the container with id 4d0a6c5d35c7e2dd8b7ca8461e23d632f75d8d9eb3010e75f093e1b4db2c4e61 Jul 08 03:24:34.866837 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:34.866789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxwgk" event={"ID":"fc84f4a9-96d4-4788-b1f5-5343d2361603","Type":"ContainerStarted","Data":"4d0a6c5d35c7e2dd8b7ca8461e23d632f75d8d9eb3010e75f093e1b4db2c4e61"} Jul 08 03:24:38.881115 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:38.881076 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxwgk" event={"ID":"fc84f4a9-96d4-4788-b1f5-5343d2361603","Type":"ContainerStarted","Data":"2bcfa6ecc9dc56968bb58577313d68eaa93f9078d237bfdcb38a295ad298cc50"} Jul 08 03:24:38.881505 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:38.881140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxwgk" event={"ID":"fc84f4a9-96d4-4788-b1f5-5343d2361603","Type":"ContainerStarted","Data":"429056d6480bbeea84adce7d0ee0a173ea34b00d8d27bc214e7eeed60c704c48"} Jul 08 03:24:41.896496 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:41.896460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxwgk" event={"ID":"fc84f4a9-96d4-4788-b1f5-5343d2361603","Type":"ContainerStarted","Data":"a436e1c81ef47ff6eed210d562d30789a97bbf9a5637462e7e692dcf5fdba2db"} Jul 08 03:24:41.915752 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:41.915699 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxwgk" podStartSLOduration=17.220306082 podStartE2EDuration="23.915682263s" totalImagesPullingTime="6.695376181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:24:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:24:41.915442213 +0000 UTC m=+272.441020345" watchObservedRunningTime="2026-07-08 03:24:41.915682263 +0000 UTC m=+272.441260385" Jul 08 03:24:44.583466 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.583429 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56755d4cb9-tsx7q"] Jul 08 03:24:44.585670 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.585653 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.588100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.588072 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 03:24:44.588217 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.588107 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 03:24:44.589130 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.589113 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5t5kv\"" Jul 08 03:24:44.589273 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.589257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 03:24:44.594110 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.594087 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 03:24:44.601246 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.601223 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56755d4cb9-tsx7q"] Jul 08 03:24:44.707316 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-tls\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707316 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcn5t\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-kube-api-access-wcn5t\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-trusted-ca\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-bound-sa-token\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-certificates\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09654b01-871b-4b5d-8ce2-6bad86cb45cd-ca-trust-extracted\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-installation-pull-secrets\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.707551 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.707530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-image-registry-private-configuration\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808405 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-bound-sa-token\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808519 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-certificates\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808519 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09654b01-871b-4b5d-8ce2-6bad86cb45cd-ca-trust-extracted\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808519 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-installation-pull-secrets\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808707 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-image-registry-private-configuration\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808768 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-tls\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808820 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcn5t\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-kube-api-access-wcn5t\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808820 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-trusted-ca\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.808949 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.808906 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09654b01-871b-4b5d-8ce2-6bad86cb45cd-ca-trust-extracted\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.809406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.809382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-certificates\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.809891 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.809871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09654b01-871b-4b5d-8ce2-6bad86cb45cd-trusted-ca\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.811240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.811219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-installation-pull-secrets\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.811356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.811303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09654b01-871b-4b5d-8ce2-6bad86cb45cd-image-registry-private-configuration\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.811477 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.811458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-registry-tls\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.819538 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.819515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-bound-sa-token\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.819797 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.819780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcn5t\" (UniqueName: \"kubernetes.io/projected/09654b01-871b-4b5d-8ce2-6bad86cb45cd-kube-api-access-wcn5t\") pod \"image-registry-56755d4cb9-tsx7q\" (UID: \"09654b01-871b-4b5d-8ce2-6bad86cb45cd\") " pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:44.895690 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:44.895660 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:45.025171 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:45.025130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56755d4cb9-tsx7q"] Jul 08 03:24:45.029156 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:24:45.029131 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09654b01_871b_4b5d_8ce2_6bad86cb45cd.slice/crio-6e64a1e37458f3fcbe814ab85040ee7ff33658dd4147a1ad99bdeacd9b1945ff WatchSource:0}: Error finding container 6e64a1e37458f3fcbe814ab85040ee7ff33658dd4147a1ad99bdeacd9b1945ff: Status 404 returned error can't find the container with id 6e64a1e37458f3fcbe814ab85040ee7ff33658dd4147a1ad99bdeacd9b1945ff Jul 08 03:24:45.909135 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:45.909098 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" event={"ID":"09654b01-871b-4b5d-8ce2-6bad86cb45cd","Type":"ContainerStarted","Data":"581b513b9bb3a90e387a9c25babd535f1e70f17d396e97b1d58f3930175a7476"} Jul 08 03:24:45.909565 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:45.909174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" event={"ID":"09654b01-871b-4b5d-8ce2-6bad86cb45cd","Type":"ContainerStarted","Data":"6e64a1e37458f3fcbe814ab85040ee7ff33658dd4147a1ad99bdeacd9b1945ff"} Jul 08 03:24:45.909565 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:45.909234 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:24:45.933081 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:45.933022 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" podStartSLOduration=1.93300646 podStartE2EDuration="1.93300646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:24:45.932114969 +0000 UTC m=+276.457693098" watchObservedRunningTime="2026-07-08 03:24:45.93300646 +0000 UTC m=+276.458584581" Jul 08 03:24:51.558375 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:51.558325 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfsb5" podUID="d58ee91a-c5a9-49e7-a0db-ab50732d9a3c" Jul 08 03:24:51.927487 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:51.927459 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:24:54.787752 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:54.787709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:24:54.790298 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:54.790276 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58ee91a-c5a9-49e7-a0db-ab50732d9a3c-metrics-tls\") pod \"dns-default-hfsb5\" (UID: \"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c\") " pod="openshift-dns/dns-default-hfsb5" Jul 08 03:24:54.931332 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:54.931298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjrkj\"" Jul 08 03:24:54.939042 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:54.939017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:24:55.069996 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:55.069913 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfsb5"] Jul 08 03:24:55.073087 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:24:55.073056 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58ee91a_c5a9_49e7_a0db_ab50732d9a3c.slice/crio-e9d9aa44a9aef0357f8aae368b14282aa05365e9d2d0f7ce19e2b314b7e29534 WatchSource:0}: Error finding container e9d9aa44a9aef0357f8aae368b14282aa05365e9d2d0f7ce19e2b314b7e29534: Status 404 returned error can't find the container with id e9d9aa44a9aef0357f8aae368b14282aa05365e9d2d0f7ce19e2b314b7e29534 Jul 08 03:24:55.941650 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:55.941593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfsb5" event={"ID":"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c","Type":"ContainerStarted","Data":"e9d9aa44a9aef0357f8aae368b14282aa05365e9d2d0f7ce19e2b314b7e29534"} Jul 08 03:24:56.947325 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:56.947232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfsb5" event={"ID":"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c","Type":"ContainerStarted","Data":"f6cd09e5ed3242ad3bebd5ccea082a4b2713d91f451ad40433b2f364fb770020"} Jul 08 03:24:56.947325 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:56.947295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfsb5" event={"ID":"d58ee91a-c5a9-49e7-a0db-ab50732d9a3c","Type":"ContainerStarted","Data":"d49e2a0d61c67db2815ad779a34e6cee1c922f634c5fc5eeab7531b8a3a59840"} Jul 08 03:24:56.947748 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:56.947331 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:24:56.966188 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:56.966140 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hfsb5" podStartSLOduration=251.36544598 podStartE2EDuration="4m12.966123453s" totalImagesPullingTime="1.600677473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:24:56.965799443 +0000 UTC m=+287.491377566" watchObservedRunningTime="2026-07-08 03:24:56.966123453 +0000 UTC m=+287.491701576" Jul 08 03:24:57.345922 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.345844 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f"] Jul 08 03:24:57.348935 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.348917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.351752 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.352085 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.352308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.352367 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.352382 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8nnd8\"" Jul 08 03:24:57.353713 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.352308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 03:24:57.362798 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.362774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f"] Jul 08 03:24:57.365722 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.365698 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lbqzw"] Jul 08 03:24:57.369096 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.369077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.372044 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.372020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 03:24:57.372149 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.372094 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 03:24:57.372149 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.372024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-msnx5\"" Jul 08 03:24:57.372272 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.372224 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 03:24:57.409911 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.409879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.410091 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.409933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a450924f-f662-4ecf-9724-5a5e1b01ec29-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.410091 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.409974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwg4p\" (UniqueName: \"kubernetes.io/projected/a450924f-f662-4ecf-9724-5a5e1b01ec29-kube-api-access-pwg4p\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.410091 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.410012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.511253 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-metrics-client-ca\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511253 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-sys\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-root\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-textfile\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511458 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-wtmp\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kgs7\" (UniqueName: \"kubernetes.io/projected/da466125-d2d7-44b2-855d-e6d9808faa55-kube-api-access-8kgs7\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a450924f-f662-4ecf-9724-5a5e1b01ec29-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:57.511511 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-tls\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwg4p\" (UniqueName: \"kubernetes.io/projected/a450924f-f662-4ecf-9724-5a5e1b01ec29-kube-api-access-pwg4p\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:24:57.511579 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls podName:a450924f-f662-4ecf-9724-5a5e1b01ec29 nodeName:}" failed. No retries permitted until 2026-07-08 03:24:58.011557259 +0000 UTC m=+288.537135369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-xdp7f" (UID: "a450924f-f662-4ecf-9724-5a5e1b01ec29") : secret "openshift-state-metrics-tls" not found Jul 08 03:24:57.511699 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.511617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.512154 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.512134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a450924f-f662-4ecf-9724-5a5e1b01ec29-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.514161 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.514136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.523045 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.523020 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwg4p\" (UniqueName: \"kubernetes.io/projected/a450924f-f662-4ecf-9724-5a5e1b01ec29-kube-api-access-pwg4p\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:57.612423 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-tls\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-metrics-client-ca\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-sys\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-root\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-textfile\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.612668 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-wtmp\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613001 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.612679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kgs7\" (UniqueName: \"kubernetes.io/projected/da466125-d2d7-44b2-855d-e6d9808faa55-kube-api-access-8kgs7\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613133 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-wtmp\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-textfile\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-sys\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da466125-d2d7-44b2-855d-e6d9808faa55-root\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613350 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.613575 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.613387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da466125-d2d7-44b2-855d-e6d9808faa55-metrics-client-ca\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.615307 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.615278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-tls\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.615307 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.615301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da466125-d2d7-44b2-855d-e6d9808faa55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.621508 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.621483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kgs7\" (UniqueName: \"kubernetes.io/projected/da466125-d2d7-44b2-855d-e6d9808faa55-kube-api-access-8kgs7\") pod \"node-exporter-lbqzw\" (UID: \"da466125-d2d7-44b2-855d-e6d9808faa55\") " pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.677807 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.677767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lbqzw" Jul 08 03:24:57.689526 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:24:57.689493 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda466125_d2d7_44b2_855d_e6d9808faa55.slice/crio-1349382dc3340cf51a8d37b6682de61ecdd359d40a5ccdecfb3792f2627baf4a WatchSource:0}: Error finding container 1349382dc3340cf51a8d37b6682de61ecdd359d40a5ccdecfb3792f2627baf4a: Status 404 returned error can't find the container with id 1349382dc3340cf51a8d37b6682de61ecdd359d40a5ccdecfb3792f2627baf4a Jul 08 03:24:57.952160 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:57.952067 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbqzw" event={"ID":"da466125-d2d7-44b2-855d-e6d9808faa55","Type":"ContainerStarted","Data":"1349382dc3340cf51a8d37b6682de61ecdd359d40a5ccdecfb3792f2627baf4a"} Jul 08 03:24:58.016757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.016707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:58.019298 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.019264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a450924f-f662-4ecf-9724-5a5e1b01ec29-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xdp7f\" (UID: \"a450924f-f662-4ecf-9724-5a5e1b01ec29\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:58.259543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.259465 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" Jul 08 03:24:58.410817 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.410774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f"] Jul 08 03:24:58.413930 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:24:58.413897 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda450924f_f662_4ecf_9724_5a5e1b01ec29.slice/crio-2174958c9890a03ffa3d50e064777c088083dec3105059090bcf69d10561fd59 WatchSource:0}: Error finding container 2174958c9890a03ffa3d50e064777c088083dec3105059090bcf69d10561fd59: Status 404 returned error can't find the container with id 2174958c9890a03ffa3d50e064777c088083dec3105059090bcf69d10561fd59 Jul 08 03:24:58.960761 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.960730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" event={"ID":"a450924f-f662-4ecf-9724-5a5e1b01ec29","Type":"ContainerStarted","Data":"295202cc37d2135924097d6858b535d6cf3011b439f009e8a79b157ca0a83ed2"} Jul 08 03:24:58.961103 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.960795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" event={"ID":"a450924f-f662-4ecf-9724-5a5e1b01ec29","Type":"ContainerStarted","Data":"5fb89d3fc66101b0f566edbf61896c26d7aa60ad4621fc9d3fdc70f022aeff13"} Jul 08 03:24:58.961103 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:58.960823 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" event={"ID":"a450924f-f662-4ecf-9724-5a5e1b01ec29","Type":"ContainerStarted","Data":"2174958c9890a03ffa3d50e064777c088083dec3105059090bcf69d10561fd59"} Jul 08 03:24:59.965599 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:59.965560 2565 generic.go:356] "Generic (PLEG): container finished" podID="da466125-d2d7-44b2-855d-e6d9808faa55" containerID="a88e1c43995507f3ebf0806d716bef0e0cc7bda9a860a42ab5154d427161ea24" exitCode=0 Jul 08 03:24:59.966088 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:59.965670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbqzw" event={"ID":"da466125-d2d7-44b2-855d-e6d9808faa55","Type":"ContainerDied","Data":"a88e1c43995507f3ebf0806d716bef0e0cc7bda9a860a42ab5154d427161ea24"} Jul 08 03:24:59.967998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:24:59.967968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" event={"ID":"a450924f-f662-4ecf-9724-5a5e1b01ec29","Type":"ContainerStarted","Data":"32bf9c51e064544c33a6f4f8a41aef018b6bb9953945eefea597d8d32b5808eb"} Jul 08 03:25:00.013775 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:00.013722 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xdp7f" podStartSLOduration=2.012044234 podStartE2EDuration="3.013703193s" totalImagesPullingTime="1.001658959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:25:00.011924265 +0000 UTC m=+290.537502387" watchObservedRunningTime="2026-07-08 03:25:00.013703193 +0000 UTC m=+290.539281315" Jul 08 03:25:00.973419 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:00.973380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbqzw" event={"ID":"da466125-d2d7-44b2-855d-e6d9808faa55","Type":"ContainerStarted","Data":"c576afe7b6dbc4c54cdf1d067f767c09eaa04edff702f1511282dd5b02ef7521"} Jul 08 03:25:00.973827 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:00.973463 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbqzw" event={"ID":"da466125-d2d7-44b2-855d-e6d9808faa55","Type":"ContainerStarted","Data":"1442c66320b6a1ae428adfc7d183443bce8eee79da9477ebfc37a18225d967b6"} Jul 08 03:25:00.996570 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:00.996519 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lbqzw" podStartSLOduration=2.692264646 podStartE2EDuration="3.99650344s" totalImagesPullingTime="1.23140957s" totalInitContainerRuntime="72.829224ms" isStatefulPod=true podCreationTimestamp="2026-07-08 03:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:25:00.995190657 +0000 UTC m=+291.520768781" watchObservedRunningTime="2026-07-08 03:25:00.99650344 +0000 UTC m=+291.522081562" Jul 08 03:25:04.374807 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.374772 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:04.385342 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.385317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.389100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.388921 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 03:25:04.389100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.388928 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 03:25:04.389100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389002 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 03:25:04.389100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389055 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:04.389404 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389245 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 03:25:04.389404 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389335 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 03:25:04.389882 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389863 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 03:25:04.389995 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389863 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 03:25:04.389995 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.389921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j2b7c\"" Jul 08 03:25:04.394373 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.394166 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 03:25:04.469929 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.469896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.469929 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.469944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8ns\" (UniqueName: \"kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.470180 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.469983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.470180 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.470026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.470180 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.470070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.470180 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.470098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.470180 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.470138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571173 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571173 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8ns\" (UniqueName: \"kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.571976 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.571950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.572259 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.572095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.572259 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.572202 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.572366 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.572307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.573918 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.573886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.574042 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.574006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.581909 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.581888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8ns\" (UniqueName: \"kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns\") pod \"console-845b4bd5d9-nznsd\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.697229 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.697118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:04.830564 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.830531 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:04.833859 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:25:04.833832 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca879244_af0c_43df_a39d_c6fba20119e4.slice/crio-9d820b01d2b752625f9199fcdb431f2d1a21d41f95712b59f22477bc35cceea6 WatchSource:0}: Error finding container 9d820b01d2b752625f9199fcdb431f2d1a21d41f95712b59f22477bc35cceea6: Status 404 returned error can't find the container with id 9d820b01d2b752625f9199fcdb431f2d1a21d41f95712b59f22477bc35cceea6 Jul 08 03:25:04.986957 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:04.986864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4bd5d9-nznsd" event={"ID":"ca879244-af0c-43df-a39d-c6fba20119e4","Type":"ContainerStarted","Data":"9d820b01d2b752625f9199fcdb431f2d1a21d41f95712b59f22477bc35cceea6"} Jul 08 03:25:06.017605 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:25:06.017560 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vzzs4" podUID="65ac74a9-81b4-499f-ad6c-9d9a4e72421f" Jul 08 03:25:06.917950 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:06.917917 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56755d4cb9-tsx7q" Jul 08 03:25:06.955070 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:06.955039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfsb5" Jul 08 03:25:07.999195 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:07.999104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4bd5d9-nznsd" event={"ID":"ca879244-af0c-43df-a39d-c6fba20119e4","Type":"ContainerStarted","Data":"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957"} Jul 08 03:25:08.019133 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:08.019077 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845b4bd5d9-nznsd" podStartSLOduration=1.18974365 podStartE2EDuration="4.019057735s" totalImagesPullingTime="2.829314085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:25:08.01784128 +0000 UTC m=+298.543419402" watchObservedRunningTime="2026-07-08 03:25:08.019057735 +0000 UTC m=+298.544635858" Jul 08 03:25:09.844405 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:09.844379 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 03:25:13.288159 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:13.288122 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:14.697623 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:14.697568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:17.016011 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:17.015965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:25:24.265616 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:24.265585 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tft8h_e3d7e2eb-d73a-4aed-91d4-449a3db96494/serve-healthcheck-canary/0.log" Jul 08 03:25:24.325587 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:24.325551 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" podUID="6e9ed805-d24a-4778-9f41-ff82975a892c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 03:25:34.326608 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:34.326165 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" podUID="6e9ed805-d24a-4778-9f41-ff82975a892c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 03:25:38.308344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.308282 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-845b4bd5d9-nznsd" podUID="ca879244-af0c-43df-a39d-c6fba20119e4" containerName="console" containerID="cri-o://852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957" gracePeriod=15 Jul 08 03:25:38.544823 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.544799 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:38.655035 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655035 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655043 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv8ns\" (UniqueName: \"kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655068 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655127 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655148 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655177 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655208 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config\") pod \"ca879244-af0c-43df-a39d-c6fba20119e4\" (UID: \"ca879244-af0c-43df-a39d-c6fba20119e4\") " Jul 08 03:25:38.655580 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655547 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:25:38.655667 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655623 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config" (OuterVolumeSpecName: "console-config") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:25:38.655732 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655662 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:25:38.655732 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.655686 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:25:38.657487 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.657457 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns" (OuterVolumeSpecName: "kube-api-access-xv8ns") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "kube-api-access-xv8ns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:25:38.657593 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.657499 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 03:25:38.657593 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.657519 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca879244-af0c-43df-a39d-c6fba20119e4" (UID: "ca879244-af0c-43df-a39d-c6fba20119e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 03:25:38.756717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756681 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756707 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-oauth-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756718 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-console-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756727 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca879244-af0c-43df-a39d-c6fba20119e4-trusted-ca-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756950 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756735 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-oauth-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756950 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756743 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca879244-af0c-43df-a39d-c6fba20119e4-console-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:38.756950 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:38.756751 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv8ns\" (UniqueName: \"kubernetes.io/projected/ca879244-af0c-43df-a39d-c6fba20119e4-kube-api-access-xv8ns\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:25:39.103674 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.103563 2565 generic.go:356] "Generic (PLEG): container finished" podID="ca879244-af0c-43df-a39d-c6fba20119e4" containerID="852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957" exitCode=0 Jul 08 03:25:39.103674 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.103612 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b4bd5d9-nznsd" Jul 08 03:25:39.103674 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.103627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4bd5d9-nznsd" event={"ID":"ca879244-af0c-43df-a39d-c6fba20119e4","Type":"ContainerDied","Data":"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957"} Jul 08 03:25:39.103877 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.103706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b4bd5d9-nznsd" event={"ID":"ca879244-af0c-43df-a39d-c6fba20119e4","Type":"ContainerDied","Data":"9d820b01d2b752625f9199fcdb431f2d1a21d41f95712b59f22477bc35cceea6"} Jul 08 03:25:39.103877 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.103735 2565 scope.go:117] "RemoveContainer" containerID="852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957" Jul 08 03:25:39.113231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.113210 2565 scope.go:117] "RemoveContainer" containerID="852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957" Jul 08 03:25:39.113542 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:25:39.113522 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957\": container with ID starting with 852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957 not found: ID does not exist" containerID="852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957" Jul 08 03:25:39.113626 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.113553 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957"} err="failed to get container status \"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957\": rpc error: code = NotFound desc = could not find container \"852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957\": container with ID starting with 852097e824cc6dab86948c6b5eae3d79ac4f65753a43fc28e9e29c0ea9ae9957 not found: ID does not exist" Jul 08 03:25:39.124238 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.124209 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:39.128094 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:39.128069 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-845b4bd5d9-nznsd"] Jul 08 03:25:40.020429 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:40.020392 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca879244-af0c-43df-a39d-c6fba20119e4" path="/var/lib/kubelet/pods/ca879244-af0c-43df-a39d-c6fba20119e4/volumes" Jul 08 03:25:44.325431 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:44.325395 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" podUID="6e9ed805-d24a-4778-9f41-ff82975a892c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 03:25:44.325931 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:44.325467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" Jul 08 03:25:44.325931 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:44.325921 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"51515418c28e27111714b46312f3255421084075588e2c476bb87c82ff063e24"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 08 03:25:44.326031 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:44.325954 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" podUID="6e9ed805-d24a-4778-9f41-ff82975a892c" containerName="service-proxy" containerID="cri-o://51515418c28e27111714b46312f3255421084075588e2c476bb87c82ff063e24" gracePeriod=30 Jul 08 03:25:45.126778 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:45.126733 2565 generic.go:356] "Generic (PLEG): container finished" podID="6e9ed805-d24a-4778-9f41-ff82975a892c" containerID="51515418c28e27111714b46312f3255421084075588e2c476bb87c82ff063e24" exitCode=2 Jul 08 03:25:45.126957 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:45.126798 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerDied","Data":"51515418c28e27111714b46312f3255421084075588e2c476bb87c82ff063e24"} Jul 08 03:25:45.126957 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:25:45.126844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d46ff747-xr5jq" event={"ID":"6e9ed805-d24a-4778-9f41-ff82975a892c","Type":"ContainerStarted","Data":"2d01af903b4b4c27bbca5815bb78d4efc4317a1c1c090a644e951d570eae016d"} Jul 08 03:26:23.892772 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:23.892720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:26:23.895186 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:23.895164 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ac74a9-81b4-499f-ad6c-9d9a4e72421f-metrics-certs\") pod \"network-metrics-daemon-vzzs4\" (UID: \"65ac74a9-81b4-499f-ad6c-9d9a4e72421f\") " pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:26:23.920204 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:23.920174 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zb8ld\"" Jul 08 03:26:23.927543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:23.927516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzzs4" Jul 08 03:26:24.061504 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:24.061312 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzzs4"] Jul 08 03:26:24.064134 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:26:24.064105 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ac74a9_81b4_499f_ad6c_9d9a4e72421f.slice/crio-52364cf166cb9820c5c4c2922650b96c77a572a2fec64f48fceb2c2aec8d76d0 WatchSource:0}: Error finding container 52364cf166cb9820c5c4c2922650b96c77a572a2fec64f48fceb2c2aec8d76d0: Status 404 returned error can't find the container with id 52364cf166cb9820c5c4c2922650b96c77a572a2fec64f48fceb2c2aec8d76d0 Jul 08 03:26:24.066146 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:24.066130 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 03:26:24.262467 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:24.262375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzzs4" event={"ID":"65ac74a9-81b4-499f-ad6c-9d9a4e72421f","Type":"ContainerStarted","Data":"52364cf166cb9820c5c4c2922650b96c77a572a2fec64f48fceb2c2aec8d76d0"} Jul 08 03:26:25.268267 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:25.268168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzzs4" event={"ID":"65ac74a9-81b4-499f-ad6c-9d9a4e72421f","Type":"ContainerStarted","Data":"c50ef9e11e526c4d716224a14e73a5f7c506e76843e31adf991e73dec477b04b"} Jul 08 03:26:25.268267 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:25.268265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzzs4" event={"ID":"65ac74a9-81b4-499f-ad6c-9d9a4e72421f","Type":"ContainerStarted","Data":"768b6084bde7f9d6de862bd38ac89f956514ed70c2fe3797dd466de128d4948a"} Jul 08 03:26:25.290212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:26:25.290151 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vzzs4" podStartSLOduration=374.420232347 podStartE2EDuration="6m15.290136183s" totalImagesPullingTime="869.903836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:26:25.289032874 +0000 UTC m=+375.814610997" watchObservedRunningTime="2026-07-08 03:26:25.290136183 +0000 UTC m=+375.815714331" Jul 08 03:28:08.126838 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.126805 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d464d4856-qn298"] Jul 08 03:28:08.127351 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.127062 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca879244-af0c-43df-a39d-c6fba20119e4" containerName="console" Jul 08 03:28:08.127351 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.127073 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca879244-af0c-43df-a39d-c6fba20119e4" containerName="console" Jul 08 03:28:08.127351 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.127130 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca879244-af0c-43df-a39d-c6fba20119e4" containerName="console" Jul 08 03:28:08.129802 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.129786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.132854 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.132831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 03:28:08.133008 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.132831 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 03:28:08.133008 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.132834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 03:28:08.133736 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.133714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 03:28:08.134129 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.134114 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8qpm9\"" Jul 08 03:28:08.134190 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.134135 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 03:28:08.140814 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.140789 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d464d4856-qn298"] Jul 08 03:28:08.142788 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.142762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83574c06-1945-4dbb-a2c3-29a124443fda-manager-config\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.142896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.142801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-metrics-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.142896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.142845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r28lj\" (UniqueName: \"kubernetes.io/projected/83574c06-1945-4dbb-a2c3-29a124443fda-kube-api-access-r28lj\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.142999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.142913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.243247 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.243207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83574c06-1945-4dbb-a2c3-29a124443fda-manager-config\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.243247 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.243242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-metrics-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.243523 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.243270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r28lj\" (UniqueName: \"kubernetes.io/projected/83574c06-1945-4dbb-a2c3-29a124443fda-kube-api-access-r28lj\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.243523 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.243305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.243974 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.243949 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83574c06-1945-4dbb-a2c3-29a124443fda-manager-config\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.245990 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.245969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.246076 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.246010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83574c06-1945-4dbb-a2c3-29a124443fda-metrics-cert\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.253202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.253179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r28lj\" (UniqueName: \"kubernetes.io/projected/83574c06-1945-4dbb-a2c3-29a124443fda-kube-api-access-r28lj\") pod \"lws-controller-manager-d464d4856-qn298\" (UID: \"83574c06-1945-4dbb-a2c3-29a124443fda\") " pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.438895 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.438790 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:08.568125 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.568093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d464d4856-qn298"] Jul 08 03:28:08.571166 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:28:08.571143 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83574c06_1945_4dbb_a2c3_29a124443fda.slice/crio-0049c1619a46ebe8f3baf5f4b522a0cb9ece4c8d5d9d0217cd0a96ec126e715a WatchSource:0}: Error finding container 0049c1619a46ebe8f3baf5f4b522a0cb9ece4c8d5d9d0217cd0a96ec126e715a: Status 404 returned error can't find the container with id 0049c1619a46ebe8f3baf5f4b522a0cb9ece4c8d5d9d0217cd0a96ec126e715a Jul 08 03:28:08.614172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:08.614135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" event={"ID":"83574c06-1945-4dbb-a2c3-29a124443fda","Type":"ContainerStarted","Data":"0049c1619a46ebe8f3baf5f4b522a0cb9ece4c8d5d9d0217cd0a96ec126e715a"} Jul 08 03:28:11.627293 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:11.627261 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" event={"ID":"83574c06-1945-4dbb-a2c3-29a124443fda","Type":"ContainerStarted","Data":"7efe0dbf28d7e29f3a1c0853ffd87ed266ca00db0401e55198471be50a8e9d82"} Jul 08 03:28:11.627711 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:11.627398 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:11.644575 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:11.644526 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" podStartSLOduration=1.110079829 podStartE2EDuration="3.644512421s" totalImagesPullingTime="2.534432592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:28:11.643797246 +0000 UTC m=+482.169375407" watchObservedRunningTime="2026-07-08 03:28:11.644512421 +0000 UTC m=+482.170090542" Jul 08 03:28:15.693397 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.693360 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4"] Jul 08 03:28:15.696543 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.696524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.715651 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.715603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4"] Jul 08 03:28:15.716875 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.716850 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 03:28:15.717303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.717282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9xhxh\"" Jul 08 03:28:15.717603 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.717586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 03:28:15.717716 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.717604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 03:28:15.717894 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.717879 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 03:28:15.797545 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.797514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.797545 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.797549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ft7\" (UniqueName: \"kubernetes.io/projected/c790f203-6488-438b-98bd-2306437a35d9-kube-api-access-82ft7\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.797842 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.797588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-tmp\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.797842 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.797673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.797842 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.797732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-manifests\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899038 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.898993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ft7\" (UniqueName: \"kubernetes.io/projected/c790f203-6488-438b-98bd-2306437a35d9-kube-api-access-82ft7\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899182 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.899061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-tmp\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899182 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.899080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899182 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.899110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-manifests\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899182 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.899136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.899564 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.899539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-manifests\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.901574 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.901548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c790f203-6488-438b-98bd-2306437a35d9-tmp\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.901821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.901798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.901880 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.901806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c790f203-6488-438b-98bd-2306437a35d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:15.913132 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:15.913109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ft7\" (UniqueName: \"kubernetes.io/projected/c790f203-6488-438b-98bd-2306437a35d9-kube-api-access-82ft7\") pod \"opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4\" (UID: \"c790f203-6488-438b-98bd-2306437a35d9\") " pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:16.006161 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:16.006059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:16.148687 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:16.148654 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4"] Jul 08 03:28:16.151543 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:28:16.151520 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc790f203_6488_438b_98bd_2306437a35d9.slice/crio-2a4d7954e05d40720727680320e34b265fb0c8ef975bc7d6a98b03f4d62542a3 WatchSource:0}: Error finding container 2a4d7954e05d40720727680320e34b265fb0c8ef975bc7d6a98b03f4d62542a3: Status 404 returned error can't find the container with id 2a4d7954e05d40720727680320e34b265fb0c8ef975bc7d6a98b03f4d62542a3 Jul 08 03:28:16.646424 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:16.646387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" event={"ID":"c790f203-6488-438b-98bd-2306437a35d9","Type":"ContainerStarted","Data":"2a4d7954e05d40720727680320e34b265fb0c8ef975bc7d6a98b03f4d62542a3"} Jul 08 03:28:19.660127 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:19.660088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" event={"ID":"c790f203-6488-438b-98bd-2306437a35d9","Type":"ContainerStarted","Data":"18d50ef67dc9f282e94c882ac7368c52cd4deda5502232ba221e32f0fe57ff3d"} Jul 08 03:28:20.665138 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:20.665103 2565 generic.go:356] "Generic (PLEG): container finished" podID="c790f203-6488-438b-98bd-2306437a35d9" containerID="18d50ef67dc9f282e94c882ac7368c52cd4deda5502232ba221e32f0fe57ff3d" exitCode=0 Jul 08 03:28:20.665535 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:20.665200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" event={"ID":"c790f203-6488-438b-98bd-2306437a35d9","Type":"ContainerDied","Data":"18d50ef67dc9f282e94c882ac7368c52cd4deda5502232ba221e32f0fe57ff3d"} Jul 08 03:28:21.671136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:21.671103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" event={"ID":"c790f203-6488-438b-98bd-2306437a35d9","Type":"ContainerStarted","Data":"930140d84b688b99ddd9ba5c16996aa491e1067ebe460059a840341fedecc562"} Jul 08 03:28:21.671531 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:21.671219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:21.692382 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:21.692326 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" podStartSLOduration=1.912451903 podStartE2EDuration="6.692310507s" totalImagesPullingTime="3.693361467s" totalInitContainerRuntime="1.086497137s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:28:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:28:21.690583947 +0000 UTC m=+492.216162069" watchObservedRunningTime="2026-07-08 03:28:21.692310507 +0000 UTC m=+492.217888629" Jul 08 03:28:22.633110 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:22.633079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d464d4856-qn298" Jul 08 03:28:32.677777 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:32.677745 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4" Jul 08 03:28:42.997959 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:42.997919 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:43.005723 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.005700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.025742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.025714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 03:28:43.025896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.025833 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 03:28:43.025896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.025850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 03:28:43.025896 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.025880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-62mfz\"" Jul 08 03:28:43.041828 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.041799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:43.122226 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122429 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122429 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122429 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122429 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5458\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.122662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.122561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.169163 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.169128 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6"] Jul 08 03:28:43.171354 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.171338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.195905 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.195871 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6"] Jul 08 03:28:43.223719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.223687 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.223719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.223733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.223998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.223753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.223998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.223884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224106 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224106 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5458\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224174 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224360 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224360 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224433 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.224783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.224757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.226434 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.226417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.226809 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.226787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.243277 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.243250 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.245421 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.245398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5458\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458\") pod \"data-science-gateway-data-science-gateway-class-548557588-wjl5r\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.315817 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.315712 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:43.325755 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1294227-dc9a-4efe-af22-a775da3698f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325755 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1294227-dc9a-4efe-af22-a775da3698f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325755 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325755 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jjs\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-kube-api-access-b5jjs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.325973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.326116 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.325996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.326116 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.326036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jjs\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-kube-api-access-b5jjs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1294227-dc9a-4efe-af22-a775da3698f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427924 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1294227-dc9a-4efe-af22-a775da3698f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427924 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.427924 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.428052 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.427992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.428164 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.428140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.428241 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.428175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.428298 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.428264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.429004 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.428974 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1294227-dc9a-4efe-af22-a775da3698f8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.430303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.430278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1294227-dc9a-4efe-af22-a775da3698f8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.430472 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.430394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1294227-dc9a-4efe-af22-a775da3698f8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.441735 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.441710 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jjs\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-kube-api-access-b5jjs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.442758 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.442741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1294227-dc9a-4efe-af22-a775da3698f8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789b5h6\" (UID: \"e1294227-dc9a-4efe-af22-a775da3698f8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.463049 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.463022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:43.465702 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:28:43.465672 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b23584_ec80_48ce_8cba_462d263afd67.slice/crio-34c3fcdbe7ed98250482179a4868a37ea570e0c7546f7c5a743e566aa1a98cde WatchSource:0}: Error finding container 34c3fcdbe7ed98250482179a4868a37ea570e0c7546f7c5a743e566aa1a98cde: Status 404 returned error can't find the container with id 34c3fcdbe7ed98250482179a4868a37ea570e0c7546f7c5a743e566aa1a98cde Jul 08 03:28:43.481403 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.481373 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:43.570719 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.570615 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d"] Jul 08 03:28:43.573607 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.573580 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.576833 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.576808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 03:28:43.577020 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.576884 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9pg5h\"" Jul 08 03:28:43.577958 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.577819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 03:28:43.577958 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.577891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 03:28:43.590397 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.590368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d"] Jul 08 03:28:43.628058 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.628031 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6"] Jul 08 03:28:43.630535 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:28:43.630507 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1294227_dc9a_4efe_af22_a775da3698f8.slice/crio-eebda85a8feac4dee3879ba4b1fddfdd4eab27e7aa7d19aeb398383ec9dca285 WatchSource:0}: Error finding container eebda85a8feac4dee3879ba4b1fddfdd4eab27e7aa7d19aeb398383ec9dca285: Status 404 returned error can't find the container with id eebda85a8feac4dee3879ba4b1fddfdd4eab27e7aa7d19aeb398383ec9dca285 Jul 08 03:28:43.730061 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269cbd5-38b0-44bf-b537-ab350352d180-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrmk\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-kube-api-access-pmrmk\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.730399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.730341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.752194 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.752156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" event={"ID":"e1294227-dc9a-4efe-af22-a775da3698f8","Type":"ContainerStarted","Data":"eebda85a8feac4dee3879ba4b1fddfdd4eab27e7aa7d19aeb398383ec9dca285"} Jul 08 03:28:43.753298 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.753275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" event={"ID":"79b23584-ec80-48ce-8cba-462d263afd67","Type":"ContainerStarted","Data":"34c3fcdbe7ed98250482179a4868a37ea570e0c7546f7c5a743e566aa1a98cde"} Jul 08 03:28:43.831254 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831254 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269cbd5-38b0-44bf-b537-ab350352d180-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831480 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrmk\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-kube-api-access-pmrmk\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831480 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831587 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831685 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.831685 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.831676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.832614 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.832586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.833843 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.833820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0269cbd5-38b0-44bf-b537-ab350352d180-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.833843 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.833834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.834016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.833968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.834016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.833977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0269cbd5-38b0-44bf-b537-ab350352d180-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.841729 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.841694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.842001 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.841985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrmk\" (UniqueName: \"kubernetes.io/projected/0269cbd5-38b0-44bf-b537-ab350352d180-kube-api-access-pmrmk\") pod \"istiod-openshift-gateway-94bb8fbfd-dnw6d\" (UID: \"0269cbd5-38b0-44bf-b537-ab350352d180\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:43.884910 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:43.884876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:44.044303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:44.044281 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d"] Jul 08 03:28:44.046320 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:28:44.046296 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0269cbd5_38b0_44bf_b537_ab350352d180.slice/crio-a3a1ad568342005c2483bb7078e03e4e8c426acc402400a5d7fab457cf3f6e08 WatchSource:0}: Error finding container a3a1ad568342005c2483bb7078e03e4e8c426acc402400a5d7fab457cf3f6e08: Status 404 returned error can't find the container with id a3a1ad568342005c2483bb7078e03e4e8c426acc402400a5d7fab457cf3f6e08 Jul 08 03:28:44.760193 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:44.760152 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" event={"ID":"0269cbd5-38b0-44bf-b537-ab350352d180","Type":"ContainerStarted","Data":"a3a1ad568342005c2483bb7078e03e4e8c426acc402400a5d7fab457cf3f6e08"} Jul 08 03:28:47.519623 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.519577 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.519954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.519590 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.519954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.519691 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.519954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.519728 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.519954 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.519692 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.525761 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.525734 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.525864 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.525804 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.525864 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.525847 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:28:47.778081 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.777981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" event={"ID":"e1294227-dc9a-4efe-af22-a775da3698f8","Type":"ContainerStarted","Data":"d918249fa233fee01377f9f85cb00fb77223b442c8f569a2cd4aa1ec6b5222d8"} Jul 08 03:28:47.779689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.779654 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" event={"ID":"79b23584-ec80-48ce-8cba-462d263afd67","Type":"ContainerStarted","Data":"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7"} Jul 08 03:28:47.781964 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.781939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" event={"ID":"0269cbd5-38b0-44bf-b537-ab350352d180","Type":"ContainerStarted","Data":"ade60555f6a854da11626b6a595bed1ab0a51cd37493590d830302aaa9d5d1b1"} Jul 08 03:28:47.782061 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.781999 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:47.810494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.810440 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" podStartSLOduration=0.918055989 podStartE2EDuration="4.810422272s" totalImagesPullingTime="3.892366283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:28:47.808253798 +0000 UTC m=+518.333831921" watchObservedRunningTime="2026-07-08 03:28:47.810422272 +0000 UTC m=+518.336000394" Jul 08 03:28:47.841573 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.841512 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" podStartSLOduration=1.370713612 podStartE2EDuration="4.841490975s" totalImagesPullingTime="3.470777363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:28:47.839593753 +0000 UTC m=+518.365171903" watchObservedRunningTime="2026-07-08 03:28:47.841490975 +0000 UTC m=+518.367069097" Jul 08 03:28:47.865428 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:47.865365 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" podStartSLOduration=1.8138616619999999 podStartE2EDuration="5.865343065s" totalImagesPullingTime="4.051481403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:28:47.862680467 +0000 UTC m=+518.388258588" watchObservedRunningTime="2026-07-08 03:28:47.865343065 +0000 UTC m=+518.390921189" Jul 08 03:28:48.316215 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.316180 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:48.317829 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.317803 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-wjl5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body= Jul 08 03:28:48.317933 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.317856 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" Jul 08 03:28:48.481826 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.481790 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:48.486663 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.486613 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:48.787028 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.786991 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:48.787907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.787890 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789b5h6" Jul 08 03:28:48.788627 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.788610 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dnw6d" Jul 08 03:28:48.905147 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:48.905115 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:49.316439 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:49.316398 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-wjl5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body= Jul 08 03:28:49.316673 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:49.316482 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" Jul 08 03:28:50.317010 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:50.316970 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-wjl5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body= Jul 08 03:28:50.317404 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:50.317027 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" Jul 08 03:28:50.794547 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:50.794509 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" containerID="cri-o://c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7" gracePeriod=30 Jul 08 03:28:56.037364 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.037333 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:56.145264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145233 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145266 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145286 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145346 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145422 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5458\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145450 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145478 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145533 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data\") pod \"79b23584-ec80-48ce-8cba-462d263afd67\" (UID: \"79b23584-ec80-48ce-8cba-462d263afd67\") " Jul 08 03:28:56.145902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145708 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:28:56.145902 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145790 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:28:56.146004 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:28:56.146004 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.145983 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:28:56.146305 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.146193 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data" (OuterVolumeSpecName: "istio-data") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:28:56.146305 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.146250 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79b23584-ec80-48ce-8cba-462d263afd67-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.146305 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.146268 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.148465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.148437 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:28:56.148593 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.148497 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:28:56.148813 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.148792 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token" (OuterVolumeSpecName: "istio-token") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:28:56.148868 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.148851 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458" (OuterVolumeSpecName: "kube-api-access-m5458") pod "79b23584-ec80-48ce-8cba-462d263afd67" (UID: "79b23584-ec80-48ce-8cba-462d263afd67"). InnerVolumeSpecName "kube-api-access-m5458". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:28:56.247363 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247323 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247363 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247356 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5458\" (UniqueName: \"kubernetes.io/projected/79b23584-ec80-48ce-8cba-462d263afd67-kube-api-access-m5458\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247363 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247366 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79b23584-ec80-48ce-8cba-462d263afd67-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247363 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247375 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247628 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247384 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247628 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247391 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.247628 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.247399 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79b23584-ec80-48ce-8cba-462d263afd67-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:28:56.819200 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.819157 2565 generic.go:356] "Generic (PLEG): container finished" podID="79b23584-ec80-48ce-8cba-462d263afd67" containerID="c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7" exitCode=0 Jul 08 03:28:56.819373 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.819210 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" Jul 08 03:28:56.819373 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.819252 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" event={"ID":"79b23584-ec80-48ce-8cba-462d263afd67","Type":"ContainerDied","Data":"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7"} Jul 08 03:28:56.819373 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.819317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r" event={"ID":"79b23584-ec80-48ce-8cba-462d263afd67","Type":"ContainerDied","Data":"34c3fcdbe7ed98250482179a4868a37ea570e0c7546f7c5a743e566aa1a98cde"} Jul 08 03:28:56.819373 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.819351 2565 scope.go:117] "RemoveContainer" containerID="c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7" Jul 08 03:28:56.828418 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.828397 2565 scope.go:117] "RemoveContainer" containerID="c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7" Jul 08 03:28:56.828776 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:28:56.828749 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7\": container with ID starting with c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7 not found: ID does not exist" containerID="c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7" Jul 08 03:28:56.828870 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.828783 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7"} err="failed to get container status \"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7\": rpc error: code = NotFound desc = could not find container \"c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7\": container with ID starting with c9ab2828928c4ec90ef0d0375e1eb9bfadef0e600b709982052245307d4eada7 not found: ID does not exist" Jul 08 03:28:56.842100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.842068 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:56.845237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:56.845210 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-wjl5r"] Jul 08 03:28:58.020390 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:28:58.020352 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b23584-ec80-48ce-8cba-462d263afd67" path="/var/lib/kubelet/pods/79b23584-ec80-48ce-8cba-462d263afd67/volumes" Jul 08 03:31:28.519542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.519509 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h"] Jul 08 03:31:28.520013 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.519849 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" Jul 08 03:31:28.520013 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.519866 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" Jul 08 03:31:28.520013 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.519948 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b23584-ec80-48ce-8cba-462d263afd67" containerName="istio-proxy" Jul 08 03:31:28.521977 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.521951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.524876 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.524852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4zxm4\"" Jul 08 03:31:28.536973 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.536942 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h"] Jul 08 03:31:28.569610 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569610 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vt2\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-kube-api-access-v8vt2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/690b5357-0149-45ac-a769-b8d57d4e8f7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.569878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.569852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.670999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.670953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vt2\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-kube-api-access-v8vt2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/690b5357-0149-45ac-a769-b8d57d4e8f7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671692 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671849 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671828 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671891 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671839 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.671947 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.671926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/690b5357-0149-45ac-a769-b8d57d4e8f7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.673777 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.673755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.673993 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.673975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.679858 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.679833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.679992 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.679937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vt2\" (UniqueName: \"kubernetes.io/projected/690b5357-0149-45ac-a769-b8d57d4e8f7c-kube-api-access-v8vt2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7df7h\" (UID: \"690b5357-0149-45ac-a769-b8d57d4e8f7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.832260 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.832160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:28.972303 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.972271 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h"] Jul 08 03:31:28.978019 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:31:28.977955 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690b5357_0149_45ac_a769_b8d57d4e8f7c.slice/crio-3563d430d5b338b682ed106c32a3180c602830ed1eea34361abb5d6d1f404ec9 WatchSource:0}: Error finding container 3563d430d5b338b682ed106c32a3180c602830ed1eea34361abb5d6d1f404ec9: Status 404 returned error can't find the container with id 3563d430d5b338b682ed106c32a3180c602830ed1eea34361abb5d6d1f404ec9 Jul 08 03:31:28.979661 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.979606 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:31:28.979787 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.979708 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:31:28.979787 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:28.979742 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:31:29.381212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:29.381172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" event={"ID":"690b5357-0149-45ac-a769-b8d57d4e8f7c","Type":"ContainerStarted","Data":"3898266eeef1b0a6938ae4867c643ac17c19d8dfb006b867e5cf64bdda7d18a5"} Jul 08 03:31:29.381435 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:29.381231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" event={"ID":"690b5357-0149-45ac-a769-b8d57d4e8f7c","Type":"ContainerStarted","Data":"3563d430d5b338b682ed106c32a3180c602830ed1eea34361abb5d6d1f404ec9"} Jul 08 03:31:29.405212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:29.405156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podStartSLOduration=1.405139361 podStartE2EDuration="1.405139361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:31:29.403938033 +0000 UTC m=+679.929516155" watchObservedRunningTime="2026-07-08 03:31:29.405139361 +0000 UTC m=+679.930717482" Jul 08 03:31:29.833380 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:29.833281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:30.837301 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:30.837267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:31.388809 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:31.388771 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:31:31.389895 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:31:31.389875 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:32:54.693262 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.693226 2565 generic.go:356] "Generic (PLEG): container finished" podID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerID="3898266eeef1b0a6938ae4867c643ac17c19d8dfb006b867e5cf64bdda7d18a5" exitCode=0 Jul 08 03:32:54.693728 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.693305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" event={"ID":"690b5357-0149-45ac-a769-b8d57d4e8f7c","Type":"ContainerDied","Data":"3898266eeef1b0a6938ae4867c643ac17c19d8dfb006b867e5cf64bdda7d18a5"} Jul 08 03:32:54.693728 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.693708 2565 scope.go:117] "RemoveContainer" containerID="3898266eeef1b0a6938ae4867c643ac17c19d8dfb006b867e5cf64bdda7d18a5" Jul 08 03:32:54.694695 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.694653 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:32:54.694827 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.694723 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:32:54.694827 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:54.694757 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:32:55.699949 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:55.699919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" event={"ID":"690b5357-0149-45ac-a769-b8d57d4e8f7c","Type":"ContainerStarted","Data":"bcad83893470ef6023de06f34d3c4ab51e195fdd818ddb2f4d845ca04501545b"} Jul 08 03:32:55.833095 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:55.833046 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:32:55.833355 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:55.833323 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7df7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body= Jul 08 03:32:55.833425 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:55.833389 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podUID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" Jul 08 03:32:56.833323 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:56.833280 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7df7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body= Jul 08 03:32:56.833877 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:56.833352 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podUID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" Jul 08 03:32:57.833453 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:57.833407 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7df7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body= Jul 08 03:32:57.833972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:57.833498 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podUID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" Jul 08 03:32:58.833513 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:58.833467 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7df7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body= Jul 08 03:32:58.833959 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:58.833538 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podUID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" Jul 08 03:32:59.833525 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:59.833486 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7df7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body= Jul 08 03:32:59.833948 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:32:59.833549 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" podUID="690b5357-0149-45ac-a769-b8d57d4e8f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" Jul 08 03:33:00.837428 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:00.837397 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:33:00.837844 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:00.837681 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:33:00.838541 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:00.838526 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7df7h" Jul 08 03:33:43.131195 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.131108 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w"] Jul 08 03:33:43.133464 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.133447 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.137258 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.137235 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 03:33:43.137423 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.137263 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 03:33:43.137423 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.137243 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 03:33:43.137423 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.137239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tb89x\"" Jul 08 03:33:43.148980 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.148952 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w"] Jul 08 03:33:43.235355 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.235550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b549199d-1115-4ec3-8885-7d8084f1a070-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.235550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.235550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsfc\" (UniqueName: \"kubernetes.io/projected/b549199d-1115-4ec3-8885-7d8084f1a070-kube-api-access-gfsfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.235550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.235755 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.235568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337012 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.336970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsfc\" (UniqueName: \"kubernetes.io/projected/b549199d-1115-4ec3-8885-7d8084f1a070-kube-api-access-gfsfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337012 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b549199d-1115-4ec3-8885-7d8084f1a070-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337530 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.337584 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.337550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.339585 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.339564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b549199d-1115-4ec3-8885-7d8084f1a070-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.339761 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.339723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b549199d-1115-4ec3-8885-7d8084f1a070-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.345993 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.345970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsfc\" (UniqueName: \"kubernetes.io/projected/b549199d-1115-4ec3-8885-7d8084f1a070-kube-api-access-gfsfc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vn45w\" (UID: \"b549199d-1115-4ec3-8885-7d8084f1a070\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.444409 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.444318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:43.583050 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.582861 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w"] Jul 08 03:33:43.586445 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:33:43.586410 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb549199d_1115_4ec3_8885_7d8084f1a070.slice/crio-425c0972b099c5cbc798d2b1952ab5e866d7dd83befb314b7c5901908fd53965 WatchSource:0}: Error finding container 425c0972b099c5cbc798d2b1952ab5e866d7dd83befb314b7c5901908fd53965: Status 404 returned error can't find the container with id 425c0972b099c5cbc798d2b1952ab5e866d7dd83befb314b7c5901908fd53965 Jul 08 03:33:43.587765 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.587745 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 03:33:43.885208 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:43.885148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" event={"ID":"b549199d-1115-4ec3-8885-7d8084f1a070","Type":"ContainerStarted","Data":"425c0972b099c5cbc798d2b1952ab5e866d7dd83befb314b7c5901908fd53965"} Jul 08 03:33:44.890224 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:44.890190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" event={"ID":"b549199d-1115-4ec3-8885-7d8084f1a070","Type":"ContainerStarted","Data":"37477d7d0dd6e046cd41e700de5a3cb83a7265865f8d1b247c6bd86e745bcc5e"} Jul 08 03:33:44.908907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:44.908851 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" podStartSLOduration=0.921259621 podStartE2EDuration="1.908833097s" totalImagesPullingTime="987.573476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:33:44.907504992 +0000 UTC m=+815.433083128" watchObservedRunningTime="2026-07-08 03:33:44.908833097 +0000 UTC m=+815.434411219" Jul 08 03:33:53.444856 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:53.444798 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:53.445332 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:53.444903 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:53.457600 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:53.457572 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:33:53.935757 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:33:53.935729 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vn45w" Jul 08 03:34:20.739522 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.739484 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7"] Jul 08 03:34:20.742237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.742214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.744880 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.744844 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 03:34:20.753043 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.753009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7"] Jul 08 03:34:20.856484 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x7d\" (UniqueName: \"kubernetes.io/projected/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-kube-api-access-j4x7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.856689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.856689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.856689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.856798 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.856798 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.856720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957688 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957688 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957687 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957932 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x7d\" (UniqueName: \"kubernetes.io/projected/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-kube-api-access-j4x7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957932 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957932 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.957932 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.957816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.958207 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.958173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.958343 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.958220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.958343 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.958244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.960198 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.960178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.960271 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.960252 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:20.966833 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:20.966810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x7d\" (UniqueName: \"kubernetes.io/projected/d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec-kube-api-access-j4x7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7\" (UID: \"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:21.054967 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:21.054867 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:21.189779 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:21.189718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7"] Jul 08 03:34:21.192170 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:34:21.192142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55e091e_3bd6_4c0d_9dbf_0bdfd5c917ec.slice/crio-207366860f95e05d2616bfab3c30eb998a4bd70f78ab9833490ecfe4aa3245d3 WatchSource:0}: Error finding container 207366860f95e05d2616bfab3c30eb998a4bd70f78ab9833490ecfe4aa3245d3: Status 404 returned error can't find the container with id 207366860f95e05d2616bfab3c30eb998a4bd70f78ab9833490ecfe4aa3245d3 Jul 08 03:34:22.032940 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:22.032907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" event={"ID":"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec","Type":"ContainerStarted","Data":"4b33fdaac1edd2502f280053ce3d15ecc401dcdbb7aa3cc8f886d4340e28c5de"} Jul 08 03:34:22.033322 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:22.032953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" event={"ID":"d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec","Type":"ContainerStarted","Data":"207366860f95e05d2616bfab3c30eb998a4bd70f78ab9833490ecfe4aa3245d3"} Jul 08 03:34:22.052114 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:22.052062 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" podStartSLOduration=1.886749907 podStartE2EDuration="2.052045671s" totalImagesPullingTime="165.295764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:34:22.050865908 +0000 UTC m=+852.576444031" watchObservedRunningTime="2026-07-08 03:34:22.052045671 +0000 UTC m=+852.577623793" Jul 08 03:34:27.230793 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.230758 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt"] Jul 08 03:34:27.233437 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.233415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.236017 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.235994 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 03:34:27.245819 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.245794 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt"] Jul 08 03:34:27.416321 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.416321 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.416550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.416550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.416550 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpgv\" (UniqueName: \"kubernetes.io/projected/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-kube-api-access-zbpgv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.416734 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.416560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.517840 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.517840 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpgv\" (UniqueName: \"kubernetes.io/projected/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-kube-api-access-zbpgv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.517928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518288 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.518264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518288 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.518283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.518357 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.518313 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.520471 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.520446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.520649 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.520614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.526238 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.526208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpgv\" (UniqueName: \"kubernetes.io/projected/c8d2690c-b8fc-433f-b73b-ca48e9ac1812-kube-api-access-zbpgv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5q6mt\" (UID: \"c8d2690c-b8fc-433f-b73b-ca48e9ac1812\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.544231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.544198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:27.683808 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:27.683782 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt"] Jul 08 03:34:27.686298 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:34:27.686264 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d2690c_b8fc_433f_b73b_ca48e9ac1812.slice/crio-71381de268f81410a69f2aca81645261526e9a66e0888328697915a6227a9cff WatchSource:0}: Error finding container 71381de268f81410a69f2aca81645261526e9a66e0888328697915a6227a9cff: Status 404 returned error can't find the container with id 71381de268f81410a69f2aca81645261526e9a66e0888328697915a6227a9cff Jul 08 03:34:28.058037 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:28.058003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" event={"ID":"c8d2690c-b8fc-433f-b73b-ca48e9ac1812","Type":"ContainerStarted","Data":"c61210ae03da48fb0b9143fe4f45d89edee42f88d91d5cc6bada35b7c450f8b5"} Jul 08 03:34:28.058272 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:28.058068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" event={"ID":"c8d2690c-b8fc-433f-b73b-ca48e9ac1812","Type":"ContainerStarted","Data":"71381de268f81410a69f2aca81645261526e9a66e0888328697915a6227a9cff"} Jul 08 03:34:28.077243 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:28.077186 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" podStartSLOduration=0.924492816 podStartE2EDuration="1.07716597s" totalImagesPullingTime="152.673154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:34:28.076622435 +0000 UTC m=+858.602200557" watchObservedRunningTime="2026-07-08 03:34:28.07716597 +0000 UTC m=+858.602744097" Jul 08 03:34:31.055344 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:31.055302 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:31.055878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:31.055362 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:31.068107 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:31.068084 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:31.082513 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:31.082483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7" Jul 08 03:34:37.544480 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:37.544442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:37.544979 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:37.544529 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:37.557049 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:37.557020 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:34:38.111463 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:34:38.111436 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5q6mt" Jul 08 03:48:54.575733 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.575700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:48:54.578893 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.578875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.581982 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.581956 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b547d5e7-openshift-default-dockercfg-ztth9\"" Jul 08 03:48:54.604312 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.604275 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:48:54.742760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.742943 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.742943 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.742943 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.742943 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspks\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.742943 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.743124 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.742978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.743124 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.743024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.743124 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.743049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.844785 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspks\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.845078 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.845078 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.844857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.845078 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.845058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.845746 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.845661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.845746 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.845662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.852734 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.852704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.853232 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.853198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.853727 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.853706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.853838 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.853824 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspks\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks\") pod \"e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:54.889774 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:54.889732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:55.030326 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.030287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:48:55.034994 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:48:55.034962 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5ff882_2f42_44b6_8140_8add5879d85b.slice/crio-9777dce7302fe0b6f490b27110d6b7d3804e2be7c9224df905e1f82686f78b03 WatchSource:0}: Error finding container 9777dce7302fe0b6f490b27110d6b7d3804e2be7c9224df905e1f82686f78b03: Status 404 returned error can't find the container with id 9777dce7302fe0b6f490b27110d6b7d3804e2be7c9224df905e1f82686f78b03 Jul 08 03:48:55.037714 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.037669 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:48:55.037801 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.037766 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:48:55.037801 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.037796 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:48:55.647999 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.647962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" event={"ID":"2b5ff882-2f42-44b6-8140-8add5879d85b","Type":"ContainerStarted","Data":"5208360f1b59823de376e3790c54e3b6e1351aad411e532c9e505434558c5fcc"} Jul 08 03:48:55.648480 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.648013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" event={"ID":"2b5ff882-2f42-44b6-8140-8add5879d85b","Type":"ContainerStarted","Data":"9777dce7302fe0b6f490b27110d6b7d3804e2be7c9224df905e1f82686f78b03"} Jul 08 03:48:55.669991 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.669940 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" podStartSLOduration=1.6699216909999999 podStartE2EDuration="1.669921691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:48:55.668449431 +0000 UTC m=+1726.194027556" watchObservedRunningTime="2026-07-08 03:48:55.669921691 +0000 UTC m=+1726.195499812" Jul 08 03:48:55.890528 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:55.890489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:56.895081 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:56.895047 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:57.657135 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:57.657103 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:48:57.658185 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:48:57.658167 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:49:00.945546 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:00.945506 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:49:00.945962 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:00.945736 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" podUID="2b5ff882-2f42-44b6-8140-8add5879d85b" containerName="istio-proxy" containerID="cri-o://5208360f1b59823de376e3790c54e3b6e1351aad411e532c9e505434558c5fcc" gracePeriod=30 Jul 08 03:49:07.702067 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.702025 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b5ff882-2f42-44b6-8140-8add5879d85b" containerID="5208360f1b59823de376e3790c54e3b6e1351aad411e532c9e505434558c5fcc" exitCode=0 Jul 08 03:49:07.702476 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.702068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" event={"ID":"2b5ff882-2f42-44b6-8140-8add5879d85b","Type":"ContainerDied","Data":"5208360f1b59823de376e3790c54e3b6e1351aad411e532c9e505434558c5fcc"} Jul 08 03:49:07.801000 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.800975 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:49:07.865436 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865404 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865436 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865438 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865472 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tspks\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865515 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865536 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865566 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865590 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865698 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865630 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865960 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865775 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:07.865960 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865829 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert\") pod \"2b5ff882-2f42-44b6-8140-8add5879d85b\" (UID: \"2b5ff882-2f42-44b6-8140-8add5879d85b\") " Jul 08 03:49:07.865960 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865941 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:07.866184 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.865980 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:07.866184 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.866143 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.866184 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.866158 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.866184 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.866167 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.866332 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.866226 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:49:07.866381 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.866357 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:07.868151 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.868125 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:07.868279 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.868141 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks" (OuterVolumeSpecName: "kube-api-access-tspks") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "kube-api-access-tspks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:49:07.868279 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.868208 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:49:07.868406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.868385 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b5ff882-2f42-44b6-8140-8add5879d85b" (UID: "2b5ff882-2f42-44b6-8140-8add5879d85b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:49:07.966815 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966770 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b5ff882-2f42-44b6-8140-8add5879d85b-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.966815 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966807 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.966815 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966816 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tspks\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-kube-api-access-tspks\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.966815 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966826 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.967087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966835 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:07.967087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:07.966842 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b5ff882-2f42-44b6-8140-8add5879d85b-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:08.707733 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:08.707696 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" event={"ID":"2b5ff882-2f42-44b6-8140-8add5879d85b","Type":"ContainerDied","Data":"9777dce7302fe0b6f490b27110d6b7d3804e2be7c9224df905e1f82686f78b03"} Jul 08 03:49:08.708166 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:08.707759 2565 scope.go:117] "RemoveContainer" containerID="5208360f1b59823de376e3790c54e3b6e1351aad411e532c9e505434558c5fcc" Jul 08 03:49:08.708166 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:08.707705 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr" Jul 08 03:49:08.730563 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:08.730521 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:49:08.737132 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:08.737102 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b547d5e7-openshift-default-5f588789d5-dwjtr"] Jul 08 03:49:10.021935 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:10.021904 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b5ff882-2f42-44b6-8140-8add5879d85b" path="/var/lib/kubelet/pods/2b5ff882-2f42-44b6-8140-8add5879d85b/volumes" Jul 08 03:49:25.437953 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.437913 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:25.438460 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.438397 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b5ff882-2f42-44b6-8140-8add5879d85b" containerName="istio-proxy" Jul 08 03:49:25.438460 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.438417 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b5ff882-2f42-44b6-8140-8add5879d85b" containerName="istio-proxy" Jul 08 03:49:25.438589 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.438501 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b5ff882-2f42-44b6-8140-8add5879d85b" containerName="istio-proxy" Jul 08 03:49:25.441086 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.441060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.443809 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.443781 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-afef641e-openshift-default-dockercfg-z9z9z\"" Jul 08 03:49:25.456911 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.456886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:25.517776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.517776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518006 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518006 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518006 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518006 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.517977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518006 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.518001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlpj\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518192 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.518051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.518192 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.518079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619383 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619383 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlpj\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619383 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619612 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619612 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619612 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.619612 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.620084 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619938 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.620399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.620098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.620399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.620145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.620399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.619991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.620399 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.620194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.621894 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.621872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.622089 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.622072 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.627437 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.627408 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.627540 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.627523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlpj\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj\") pod \"e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.754847 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.754751 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:25.896327 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.896290 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:25.899235 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:49:25.899210 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73456e41_5c7f_49cb_863f_770347c473f2.slice/crio-7126b410a1b83e3370e2cf6b2d40f9c7952c1eecd00c07c17257afce13851a1f WatchSource:0}: Error finding container 7126b410a1b83e3370e2cf6b2d40f9c7952c1eecd00c07c17257afce13851a1f: Status 404 returned error can't find the container with id 7126b410a1b83e3370e2cf6b2d40f9c7952c1eecd00c07c17257afce13851a1f Jul 08 03:49:25.901288 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.901253 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:49:25.901368 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.901321 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:49:25.901368 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:25.901348 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:49:26.790962 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:26.790922 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" event={"ID":"73456e41-5c7f-49cb-863f-770347c473f2","Type":"ContainerStarted","Data":"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f"} Jul 08 03:49:26.791398 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:26.790980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" event={"ID":"73456e41-5c7f-49cb-863f-770347c473f2","Type":"ContainerStarted","Data":"7126b410a1b83e3370e2cf6b2d40f9c7952c1eecd00c07c17257afce13851a1f"} Jul 08 03:49:26.835717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:26.835659 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" podStartSLOduration=1.8356210210000001 podStartE2EDuration="1.835621021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:49:26.831818277 +0000 UTC m=+1757.357396399" watchObservedRunningTime="2026-07-08 03:49:26.835621021 +0000 UTC m=+1757.361199145" Jul 08 03:49:27.755343 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:27.755306 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:27.760205 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:27.760181 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:27.795521 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:27.795490 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:27.796577 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:27.796560 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:31.250447 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:31.250415 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:31.250901 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:31.250622 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" podUID="73456e41-5c7f-49cb-863f-770347c473f2" containerName="istio-proxy" containerID="cri-o://69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f" gracePeriod=30 Jul 08 03:49:38.194452 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.194418 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:38.337983 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.337900 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.337983 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.337939 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrlpj\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.337983 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.337962 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.337983 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.337985 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338276 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338154 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338276 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338195 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338276 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338250 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338424 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338276 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:38.338424 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338348 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338424 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338374 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs\") pod \"73456e41-5c7f-49cb-863f-770347c473f2\" (UID: \"73456e41-5c7f-49cb-863f-770347c473f2\") " Jul 08 03:49:38.338577 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338433 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:38.338746 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338706 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:38.338851 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338770 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.338851 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.338794 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.339137 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.339111 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:38.339331 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.339178 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:49:38.340461 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.340435 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:49:38.340910 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.340874 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:49:38.341074 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.340968 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj" (OuterVolumeSpecName: "kube-api-access-qrlpj") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "kube-api-access-qrlpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:49:38.341124 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.341089 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73456e41-5c7f-49cb-863f-770347c473f2" (UID: "73456e41-5c7f-49cb-863f-770347c473f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:49:38.440099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440057 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73456e41-5c7f-49cb-863f-770347c473f2-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440090 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrlpj\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-kube-api-access-qrlpj\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440101 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440109 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440358 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440117 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73456e41-5c7f-49cb-863f-770347c473f2-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440358 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440126 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73456e41-5c7f-49cb-863f-770347c473f2-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.440358 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.440133 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73456e41-5c7f-49cb-863f-770347c473f2-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:49:38.853362 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.853330 2565 generic.go:356] "Generic (PLEG): container finished" podID="73456e41-5c7f-49cb-863f-770347c473f2" containerID="69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f" exitCode=0 Jul 08 03:49:38.853542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.853381 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" Jul 08 03:49:38.853542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.853399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" event={"ID":"73456e41-5c7f-49cb-863f-770347c473f2","Type":"ContainerDied","Data":"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f"} Jul 08 03:49:38.853542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.853484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn" event={"ID":"73456e41-5c7f-49cb-863f-770347c473f2","Type":"ContainerDied","Data":"7126b410a1b83e3370e2cf6b2d40f9c7952c1eecd00c07c17257afce13851a1f"} Jul 08 03:49:38.853542 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.853512 2565 scope.go:117] "RemoveContainer" containerID="69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f" Jul 08 03:49:38.862456 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.862434 2565 scope.go:117] "RemoveContainer" containerID="69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f" Jul 08 03:49:38.862756 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:49:38.862738 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f\": container with ID starting with 69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f not found: ID does not exist" containerID="69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f" Jul 08 03:49:38.862842 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.862765 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f"} err="failed to get container status \"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f\": rpc error: code = NotFound desc = could not find container \"69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f\": container with ID starting with 69d8647e5d063c43af25aab19e0eb69a97838ba775ab5ba76dbca2a1cd7c879f not found: ID does not exist" Jul 08 03:49:38.876135 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.876094 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:38.878234 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:38.878210 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-afef641e-openshift-default-5c89bc944c-pq6jn"] Jul 08 03:49:40.021333 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:49:40.021301 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73456e41-5c7f-49cb-863f-770347c473f2" path="/var/lib/kubelet/pods/73456e41-5c7f-49cb-863f-770347c473f2/volumes" Jul 08 03:51:12.573056 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.573013 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:12.573687 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.573345 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73456e41-5c7f-49cb-863f-770347c473f2" containerName="istio-proxy" Jul 08 03:51:12.573687 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.573357 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73456e41-5c7f-49cb-863f-770347c473f2" containerName="istio-proxy" Jul 08 03:51:12.573687 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.573426 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73456e41-5c7f-49cb-863f-770347c473f2" containerName="istio-proxy" Jul 08 03:51:12.576280 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.576262 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.578967 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.578944 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fcd8d42d-openshift-default-dockercfg-z7fh2\"" Jul 08 03:51:12.630291 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.630251 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:12.659558 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.659520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.659840 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.659811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.659984 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.659869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.659984 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.659911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.660094 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.659989 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.660094 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.660032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.660094 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.660053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.660231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.660125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.660231 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.660158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jfm\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.760861 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.760861 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.760976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jfm\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761351 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761398 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761657 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761764 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.761764 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.761741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.763681 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.763660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.763800 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.763781 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.769410 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.769387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.769586 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.769567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jfm\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm\") pod \"e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:12.886682 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:12.886610 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:13.031114 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.031089 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:13.033160 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:51:13.033130 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050584c3_b7e4_44cb_95eb_22478f450334.slice/crio-7eb932880e1df96832ab419b9262b1c40227c410f5c180e3c76feb56f61db014 WatchSource:0}: Error finding container 7eb932880e1df96832ab419b9262b1c40227c410f5c180e3c76feb56f61db014: Status 404 returned error can't find the container with id 7eb932880e1df96832ab419b9262b1c40227c410f5c180e3c76feb56f61db014 Jul 08 03:51:13.035295 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.035251 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:13.035406 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.035387 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:13.035464 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.035439 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:13.248760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.248660 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerStarted","Data":"25bc6fda61198027caf742fde3c21d0e482efdfe4e27b6802d53324b80396ca9"} Jul 08 03:51:13.248760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.248716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerStarted","Data":"7eb932880e1df96832ab419b9262b1c40227c410f5c180e3c76feb56f61db014"} Jul 08 03:51:13.270044 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.269968 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" podStartSLOduration=1.269950194 podStartE2EDuration="1.269950194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:51:13.268339856 +0000 UTC m=+1863.793917979" watchObservedRunningTime="2026-07-08 03:51:13.269950194 +0000 UTC m=+1863.795528317" Jul 08 03:51:13.887297 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:13.887256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:14.892706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:14.892674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:15.256237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:15.256150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:15.257242 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:15.257220 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:29.317266 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.317230 2565 generic.go:356] "Generic (PLEG): container finished" podID="050584c3-b7e4-44cb-95eb-22478f450334" containerID="25bc6fda61198027caf742fde3c21d0e482efdfe4e27b6802d53324b80396ca9" exitCode=0 Jul 08 03:51:29.317745 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.317293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerDied","Data":"25bc6fda61198027caf742fde3c21d0e482efdfe4e27b6802d53324b80396ca9"} Jul 08 03:51:29.317745 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.317671 2565 scope.go:117] "RemoveContainer" containerID="25bc6fda61198027caf742fde3c21d0e482efdfe4e27b6802d53324b80396ca9" Jul 08 03:51:29.318721 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.318689 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:29.318795 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.318764 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:29.318833 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:29.318801 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:30.256202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:30.256104 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:30.324521 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:30.324484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerStarted","Data":"6d348a23c99e617a16ad0d817e43e115db1a817a2cee5fa3bcb5152aa6b614b1"} Jul 08 03:51:30.887165 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:30.887126 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:30.888179 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:30.888151 2565 patch_prober.go:28] interesting pod/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 08 03:51:30.888296 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:30.888201 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 08 03:51:31.888095 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:31.888058 2565 patch_prober.go:28] interesting pod/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 08 03:51:31.888515 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:31.888117 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 08 03:51:32.887801 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:32.887756 2565 patch_prober.go:28] interesting pod/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 08 03:51:32.888009 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:32.887837 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 08 03:51:33.661153 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:33.661114 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:33.661680 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:33.661358 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" containerID="cri-o://6d348a23c99e617a16ad0d817e43e115db1a817a2cee5fa3bcb5152aa6b614b1" gracePeriod=30 Jul 08 03:51:39.368607 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.368561 2565 generic.go:356] "Generic (PLEG): container finished" podID="050584c3-b7e4-44cb-95eb-22478f450334" containerID="6d348a23c99e617a16ad0d817e43e115db1a817a2cee5fa3bcb5152aa6b614b1" exitCode=0 Jul 08 03:51:39.369067 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.368655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerDied","Data":"6d348a23c99e617a16ad0d817e43e115db1a817a2cee5fa3bcb5152aa6b614b1"} Jul 08 03:51:39.369067 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.368727 2565 scope.go:117] "RemoveContainer" containerID="25bc6fda61198027caf742fde3c21d0e482efdfe4e27b6802d53324b80396ca9" Jul 08 03:51:39.407188 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.407166 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:39.500805 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500698 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.500805 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500747 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.500805 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500764 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jfm\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.500805 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500781 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.500805 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500803 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.501172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500836 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.501172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500880 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.501172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.501172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.500987 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo\") pod \"050584c3-b7e4-44cb-95eb-22478f450334\" (UID: \"050584c3-b7e4-44cb-95eb-22478f450334\") " Jul 08 03:51:39.501172 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.501071 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:51:39.501478 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.501307 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.501478 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.501365 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:51:39.501782 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.501494 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:51:39.501939 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.501908 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:51:39.502229 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.502201 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data" (OuterVolumeSpecName: "istio-data") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:51:39.503280 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.503255 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:51:39.503381 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.503361 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:51:39.503578 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.503552 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token" (OuterVolumeSpecName: "istio-token") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:51:39.503578 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.503561 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm" (OuterVolumeSpecName: "kube-api-access-r2jfm") pod "050584c3-b7e4-44cb-95eb-22478f450334" (UID: "050584c3-b7e4-44cb-95eb-22478f450334"). InnerVolumeSpecName "kube-api-access-r2jfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:51:39.602220 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602179 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jfm\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-kube-api-access-r2jfm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602220 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602214 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602220 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602226 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602237 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/050584c3-b7e4-44cb-95eb-22478f450334-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602249 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/050584c3-b7e4-44cb-95eb-22478f450334-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602260 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602270 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/050584c3-b7e4-44cb-95eb-22478f450334-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:39.602465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:39.602280 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/050584c3-b7e4-44cb-95eb-22478f450334-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:51:40.373608 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:40.373577 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" Jul 08 03:51:40.373608 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:40.373586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf" event={"ID":"050584c3-b7e4-44cb-95eb-22478f450334","Type":"ContainerDied","Data":"7eb932880e1df96832ab419b9262b1c40227c410f5c180e3c76feb56f61db014"} Jul 08 03:51:40.374153 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:40.373672 2565 scope.go:117] "RemoveContainer" containerID="6d348a23c99e617a16ad0d817e43e115db1a817a2cee5fa3bcb5152aa6b614b1" Jul 08 03:51:40.430195 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:40.430155 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:40.444293 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:40.444254 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fcd8d42d-openshift-default-5b4f945467-r6cnf"] Jul 08 03:51:42.021275 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:42.021239 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="050584c3-b7e4-44cb-95eb-22478f450334" path="/var/lib/kubelet/pods/050584c3-b7e4-44cb-95eb-22478f450334/volumes" Jul 08 03:51:53.488089 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.488057 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:51:53.488579 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.488357 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:51:53.488579 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.488369 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:51:53.488579 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.488427 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:51:53.488579 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.488435 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:51:53.492735 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.492717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.495358 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.495336 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-11ba793b-openshift-default-dockercfg-r9tpq\"" Jul 08 03:51:53.503246 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.503219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:51:53.626134 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626134 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hlp\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.626492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.626430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.726888 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.726848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727062 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.726896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727062 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.726927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727062 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727161 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hlp\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727199 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727340 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727340 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727579 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727758 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727740 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727964 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.727964 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.727901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.729727 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.729706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.729949 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.729928 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.738511 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.738449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.738912 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.738889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hlp\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp\") pod \"e2e-mt-11ba793b-openshift-default-7996887bbc-rr625\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.803082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.803037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:53.945257 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.945233 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:51:53.948013 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:51:53.947988 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c724d4_a2af_4c99_ac1c_71d376fec909.slice/crio-7f1e6f6824ba44fb5aa32297ef00d3b1303404e5a15af5dd5d348213dc9f99bc WatchSource:0}: Error finding container 7f1e6f6824ba44fb5aa32297ef00d3b1303404e5a15af5dd5d348213dc9f99bc: Status 404 returned error can't find the container with id 7f1e6f6824ba44fb5aa32297ef00d3b1303404e5a15af5dd5d348213dc9f99bc Jul 08 03:51:53.950120 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.950087 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:53.950188 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.950160 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:53.950224 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:53.950197 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:51:54.434976 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:54.434939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerStarted","Data":"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f"} Jul 08 03:51:54.435166 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:54.435000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerStarted","Data":"7f1e6f6824ba44fb5aa32297ef00d3b1303404e5a15af5dd5d348213dc9f99bc"} Jul 08 03:51:54.456360 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:54.456308 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podStartSLOduration=1.4562926489999999 podStartE2EDuration="1.456292649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:51:54.455131654 +0000 UTC m=+1904.980709776" watchObservedRunningTime="2026-07-08 03:51:54.456292649 +0000 UTC m=+1904.981870772" Jul 08 03:51:54.804230 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:54.804136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:55.808505 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:55.808471 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:56.444557 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:56.444520 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:51:56.445711 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:51:56.445689 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:52:11.446760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.446722 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 08 03:52:11.447225 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.446781 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 08 03:52:11.516082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.516050 2565 generic.go:356] "Generic (PLEG): container finished" podID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerID="d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f" exitCode=0 Jul 08 03:52:11.516279 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.516102 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerDied","Data":"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f"} Jul 08 03:52:11.516565 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.516547 2565 scope.go:117] "RemoveContainer" containerID="d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f" Jul 08 03:52:11.517671 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.517618 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:52:11.517773 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.517716 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:52:11.517773 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:11.517750 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:52:12.525703 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:12.524816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerStarted","Data":"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc"} Jul 08 03:52:12.803419 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:12.803326 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:52:12.803578 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:12.803522 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 08 03:52:12.803625 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:12.803569 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 08 03:52:13.803615 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:13.803577 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 08 03:52:13.804039 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:13.803659 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 08 03:52:14.804007 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:14.803967 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 08 03:52:14.804412 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:14.804026 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 08 03:52:15.804398 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:15.804357 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 08 03:52:15.804814 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:15.804428 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 08 03:52:16.807369 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:16.807337 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:52:16.807776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:16.807744 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:52:16.808476 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:52:16.808456 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:53:43.048703 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:43.048663 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:53:43.049141 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:43.048893 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" containerID="cri-o://601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc" gracePeriod=30 Jul 08 03:53:46.810232 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:46.810195 2565 patch_prober.go:28] interesting pod/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 03:53:46.810674 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:46.810266 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 03:53:48.297885 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.297851 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:53:48.366858 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366830 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366887 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366961 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.366975 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367000 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367033 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367016 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367350 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367077 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9hlp\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp\") pod \"08c724d4-a2af-4c99-ac1c-71d376fec909\" (UID: \"08c724d4-a2af-4c99-ac1c-71d376fec909\") " Jul 08 03:53:48.367350 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367186 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:53:48.367454 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367400 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:53:48.367512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367466 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:53:48.367512 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367494 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:53:48.367689 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367669 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.367776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367693 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.367776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367724 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08c724d4-a2af-4c99-ac1c-71d376fec909-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.367776 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367737 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.368092 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.367999 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data" (OuterVolumeSpecName: "istio-data") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:53:48.369452 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.369429 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:53:48.369570 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.369495 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:53:48.369856 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.369839 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp" (OuterVolumeSpecName: "kube-api-access-v9hlp") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "kube-api-access-v9hlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:53:48.369913 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.369868 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token" (OuterVolumeSpecName: "istio-token") pod "08c724d4-a2af-4c99-ac1c-71d376fec909" (UID: "08c724d4-a2af-4c99-ac1c-71d376fec909"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:53:48.468148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.468109 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.468148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.468140 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9hlp\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-kube-api-access-v9hlp\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.468148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.468150 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.468148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.468158 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.468404 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.468167 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08c724d4-a2af-4c99-ac1c-71d376fec909-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:53:48.941501 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.941457 2565 generic.go:356] "Generic (PLEG): container finished" podID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerID="601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc" exitCode=0 Jul 08 03:53:48.941697 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.941507 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" Jul 08 03:53:48.941697 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.941538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerDied","Data":"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc"} Jul 08 03:53:48.941697 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.941593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625" event={"ID":"08c724d4-a2af-4c99-ac1c-71d376fec909","Type":"ContainerDied","Data":"7f1e6f6824ba44fb5aa32297ef00d3b1303404e5a15af5dd5d348213dc9f99bc"} Jul 08 03:53:48.941697 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.941615 2565 scope.go:117] "RemoveContainer" containerID="601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc" Jul 08 03:53:48.955108 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.955084 2565 scope.go:117] "RemoveContainer" containerID="d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f" Jul 08 03:53:48.963371 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.963348 2565 scope.go:117] "RemoveContainer" containerID="601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc" Jul 08 03:53:48.963698 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:53:48.963677 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc\": container with ID starting with 601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc not found: ID does not exist" containerID="601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc" Jul 08 03:53:48.963767 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.963708 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc"} err="failed to get container status \"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc\": rpc error: code = NotFound desc = could not find container \"601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc\": container with ID starting with 601592febabade73f2ae16069c86224bf69d6fb6f522aebde38601b497d60bfc not found: ID does not exist" Jul 08 03:53:48.963767 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.963729 2565 scope.go:117] "RemoveContainer" containerID="d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f" Jul 08 03:53:48.963963 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:53:48.963944 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f\": container with ID starting with d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f not found: ID does not exist" containerID="d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f" Jul 08 03:53:48.964001 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.963969 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f"} err="failed to get container status \"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f\": rpc error: code = NotFound desc = could not find container \"d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f\": container with ID starting with d122773ef7eb01e8b1e2ffad85514272f2fbf2ede3d861d3dd5fdbba3170be0f not found: ID does not exist" Jul 08 03:53:48.966693 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.966666 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:53:48.970300 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:48.970278 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-11ba793b-openshift-default-7996887bbc-rr625"] Jul 08 03:53:50.020742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:53:50.020708 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" path="/var/lib/kubelet/pods/08c724d4-a2af-4c99-ac1c-71d376fec909/volumes" Jul 08 03:54:37.402998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.402892 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403201 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403213 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="050584c3-b7e4-44cb-95eb-22478f450334" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403224 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403230 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403242 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403248 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403306 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.403485 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.403315 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c724d4-a2af-4c99-ac1c-71d376fec909" containerName="istio-proxy" Jul 08 03:54:37.406302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.406284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.410942 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.410915 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-78a872-openshift-default-dockercfg-gnkj5\"" Jul 08 03:54:37.431545 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.431513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:54:37.500209 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500391 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6stc\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500590 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.500590 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.500479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601647 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.601821 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.602047 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.601839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6stc\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.602346 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.602303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.602494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.602361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.602494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.602418 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.602494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.602444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.606662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.602859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.606662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.603033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.606662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.603077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.606662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.605158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.606662 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.605588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.611792 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.611768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.612050 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.612029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6stc\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc\") pod \"e2e-inf-a-78a872-openshift-default-546888bcdc-qm885\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.717119 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.717011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:37.863246 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.863219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:54:37.865543 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:54:37.865512 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaa3417_2d48_4e56_823e_b0700707b855.slice/crio-3ea2dff341c9027b6b24921c9a289869b25d0b2f087b405f07e81288b9f30c7c WatchSource:0}: Error finding container 3ea2dff341c9027b6b24921c9a289869b25d0b2f087b405f07e81288b9f30c7c: Status 404 returned error can't find the container with id 3ea2dff341c9027b6b24921c9a289869b25d0b2f087b405f07e81288b9f30c7c Jul 08 03:54:37.867928 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.867885 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:37.868011 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.867961 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:37.868011 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:37.867991 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:38.144066 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:38.144029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerStarted","Data":"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47"} Jul 08 03:54:38.144269 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:38.144078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerStarted","Data":"3ea2dff341c9027b6b24921c9a289869b25d0b2f087b405f07e81288b9f30c7c"} Jul 08 03:54:38.167188 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:38.167132 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podStartSLOduration=1.167116671 podStartE2EDuration="1.167116671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:54:38.165899515 +0000 UTC m=+2068.691477638" watchObservedRunningTime="2026-07-08 03:54:38.167116671 +0000 UTC m=+2068.692694793" Jul 08 03:54:38.718041 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:38.718006 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:38.722886 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:38.722860 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:39.149291 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:39.149250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:39.150420 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:39.150399 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:45.144397 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.144356 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:54:45.148300 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.148277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.150915 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.150889 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-18addd-openshift-default-dockercfg-svrks\"" Jul 08 03:54:45.159069 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.159044 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:54:45.172752 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.172721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.172907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.172756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.172907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.172785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.172979 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.172937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.173016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.172987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.173064 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.173049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.173098 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.173080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.173131 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.173113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.173170 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.173148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4g8\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273678 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.273852 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4g8\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274087 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.273968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274239 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.274143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274239 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.274216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274402 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.274369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274402 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.274400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.274576 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.274421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.276372 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.276348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.276568 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.276546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.282281 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.282257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.282413 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.282337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4g8\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8\") pod \"e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.460291 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.460191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:45.603374 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.603336 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:54:45.605911 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:54:45.605884 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18926691_cff6_45ce_8471_a3a5b6f29c0c.slice/crio-b8719863e9f970122330df0f5aaeae82f077bf9a56e620b2ca09b26fe4b6ce26 WatchSource:0}: Error finding container b8719863e9f970122330df0f5aaeae82f077bf9a56e620b2ca09b26fe4b6ce26: Status 404 returned error can't find the container with id b8719863e9f970122330df0f5aaeae82f077bf9a56e620b2ca09b26fe4b6ce26 Jul 08 03:54:45.608524 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.608493 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:45.608586 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.608560 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:45.608622 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:45.608586 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:46.181218 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.181170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerStarted","Data":"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15"} Jul 08 03:54:46.181754 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.181245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerStarted","Data":"b8719863e9f970122330df0f5aaeae82f077bf9a56e620b2ca09b26fe4b6ce26"} Jul 08 03:54:46.203690 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.203622 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podStartSLOduration=1.203604592 podStartE2EDuration="1.203604592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:54:46.201747741 +0000 UTC m=+2076.727325863" watchObservedRunningTime="2026-07-08 03:54:46.203604592 +0000 UTC m=+2076.729182780" Jul 08 03:54:46.461227 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.461139 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:46.462938 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.462902 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:54:46.463093 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:46.462970 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:54:47.465165 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:47.465129 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:48.190987 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:48.190944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:48.191839 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:48.191817 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:54:55.190879 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:55.190834 2565 patch_prober.go:28] interesting pod/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 03:54:55.191310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:55.190905 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 03:54:56.232404 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.232353 2565 generic.go:356] "Generic (PLEG): container finished" podID="ceaa3417-2d48-4e56-823e-b0700707b855" containerID="594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47" exitCode=0 Jul 08 03:54:56.232966 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.232411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerDied","Data":"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47"} Jul 08 03:54:56.232966 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.232949 2565 scope.go:117] "RemoveContainer" containerID="594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47" Jul 08 03:54:56.234421 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.234382 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:56.234523 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.234484 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:56.234581 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:56.234550 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:54:57.242210 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:57.242161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerStarted","Data":"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214"} Jul 08 03:54:57.718247 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:57.717799 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:54:57.718247 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:57.717932 2565 patch_prober.go:28] interesting pod/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 08 03:54:57.718247 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:57.717979 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 08 03:54:58.718256 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:58.718204 2565 patch_prober.go:28] interesting pod/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 08 03:54:58.718803 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:58.718278 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 08 03:54:59.718560 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:59.718516 2565 patch_prober.go:28] interesting pod/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 08 03:54:59.719574 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:54:59.719139 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 08 03:55:00.718379 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:00.718336 2565 patch_prober.go:28] interesting pod/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 08 03:55:00.718722 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:00.718687 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 08 03:55:01.721017 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:01.720977 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:55:01.721425 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:01.721403 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:55:01.722061 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:01.722044 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:55:03.192988 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.192949 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:55:03.193416 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.193012 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:55:03.277937 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.277904 2565 generic.go:356] "Generic (PLEG): container finished" podID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerID="8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15" exitCode=0 Jul 08 03:55:03.278101 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.277982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerDied","Data":"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15"} Jul 08 03:55:03.278482 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.278465 2565 scope.go:117] "RemoveContainer" containerID="8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15" Jul 08 03:55:03.279568 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.279541 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:55:03.279677 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.279612 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:55:03.279677 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:03.279669 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:55:04.283767 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:04.283731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerStarted","Data":"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6"} Jul 08 03:55:04.461371 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:04.461331 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:55:04.461574 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:04.461549 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:55:04.461625 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:04.461601 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:55:05.460617 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:05.460572 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:55:05.461136 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:05.460687 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:55:06.461015 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:06.460973 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:55:06.461425 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:06.461043 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:55:07.461524 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:07.461483 2565 patch_prober.go:28] interesting pod/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 08 03:55:07.461975 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:07.461555 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 08 03:55:08.465013 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:08.464981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:55:08.465468 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:08.465259 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:55:08.466144 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:55:08.466126 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:57:05.962280 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:05.962242 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:57:05.962878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:05.962485 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" containerID="cri-o://9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214" gracePeriod=30 Jul 08 03:57:11.214418 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.214394 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:57:11.301717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301717 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301674 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6stc\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301722 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301750 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301779 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301842 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301871 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.301951 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301936 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket\") pod \"ceaa3417-2d48-4e56-823e-b0700707b855\" (UID: \"ceaa3417-2d48-4e56-823e-b0700707b855\") " Jul 08 03:57:11.302302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.301956 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:11.302302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302149 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:11.302302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302272 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.302302 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302292 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.302508 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302353 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:11.302508 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302373 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:57:11.302665 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.302613 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data" (OuterVolumeSpecName: "istio-data") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:11.304162 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.304132 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc" (OuterVolumeSpecName: "kube-api-access-r6stc") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "kube-api-access-r6stc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:11.304307 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.304220 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:57:11.304307 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.304239 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token" (OuterVolumeSpecName: "istio-token") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:11.304515 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.304500 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ceaa3417-2d48-4e56-823e-b0700707b855" (UID: "ceaa3417-2d48-4e56-823e-b0700707b855"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:11.402965 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402917 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.402965 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402953 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceaa3417-2d48-4e56-823e-b0700707b855-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.402965 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402962 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.402965 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402973 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6stc\" (UniqueName: \"kubernetes.io/projected/ceaa3417-2d48-4e56-823e-b0700707b855-kube-api-access-r6stc\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.402965 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402982 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.403254 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402990 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceaa3417-2d48-4e56-823e-b0700707b855-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.403254 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.402997 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceaa3417-2d48-4e56-823e-b0700707b855-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:11.840063 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.840029 2565 generic.go:356] "Generic (PLEG): container finished" podID="ceaa3417-2d48-4e56-823e-b0700707b855" containerID="9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214" exitCode=0 Jul 08 03:57:11.840244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.840069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerDied","Data":"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214"} Jul 08 03:57:11.840244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.840087 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" Jul 08 03:57:11.840244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.840145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885" event={"ID":"ceaa3417-2d48-4e56-823e-b0700707b855","Type":"ContainerDied","Data":"3ea2dff341c9027b6b24921c9a289869b25d0b2f087b405f07e81288b9f30c7c"} Jul 08 03:57:11.840244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.840169 2565 scope.go:117] "RemoveContainer" containerID="9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214" Jul 08 03:57:11.849196 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.849124 2565 scope.go:117] "RemoveContainer" containerID="594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47" Jul 08 03:57:11.858186 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.858160 2565 scope.go:117] "RemoveContainer" containerID="9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214" Jul 08 03:57:11.858564 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:11.858528 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214\": container with ID starting with 9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214 not found: ID does not exist" containerID="9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214" Jul 08 03:57:11.858787 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.858572 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214"} err="failed to get container status \"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214\": rpc error: code = NotFound desc = could not find container \"9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214\": container with ID starting with 9bc2bbbf1e44c2ca628c1d97e46a8c6fa2c7f7dd94e3c07e93ab1747a60b7214 not found: ID does not exist" Jul 08 03:57:11.858787 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.858593 2565 scope.go:117] "RemoveContainer" containerID="594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47" Jul 08 03:57:11.859051 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:11.859021 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47\": container with ID starting with 594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47 not found: ID does not exist" containerID="594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47" Jul 08 03:57:11.859158 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.859079 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47"} err="failed to get container status \"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47\": rpc error: code = NotFound desc = could not find container \"594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47\": container with ID starting with 594933614e8ba54069e84dcc17e6d992ed6d57d8723eaaaa4c71922ac511db47 not found: ID does not exist" Jul 08 03:57:11.861290 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.861268 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:57:11.864840 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:11.864820 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-78a872-openshift-default-546888bcdc-qm885"] Jul 08 03:57:12.022125 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:12.022079 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" path="/var/lib/kubelet/pods/ceaa3417-2d48-4e56-823e-b0700707b855/volumes" Jul 08 03:57:12.842116 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:12.842087 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:57:12.842494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:12.842285 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" containerID="cri-o://992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6" gracePeriod=30 Jul 08 03:57:18.103196 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.103167 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:57:18.161686 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161612 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161737 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161782 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161800 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h4g8\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161831 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161847 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.161898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.161869 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.162210 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162129 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:18.162210 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.162310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162237 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:57:18.162310 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162249 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs\") pod \"18926691-cff6-45ce-8471-a3a5b6f29c0c\" (UID: \"18926691-cff6-45ce-8471-a3a5b6f29c0c\") " Jul 08 03:57:18.162582 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162517 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:18.162582 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162532 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:18.162823 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162724 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.162823 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162804 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18926691-cff6-45ce-8471-a3a5b6f29c0c-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.162932 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.162896 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:18.164277 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.164244 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:18.164388 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.164306 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8" (OuterVolumeSpecName: "kube-api-access-5h4g8") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "kube-api-access-5h4g8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:18.164388 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.164333 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:18.164461 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.164417 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18926691-cff6-45ce-8471-a3a5b6f29c0c" (UID: "18926691-cff6-45ce-8471-a3a5b6f29c0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:57:18.263742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263699 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h4g8\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-kube-api-access-5h4g8\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263738 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263742 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263748 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263757 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263766 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263774 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18926691-cff6-45ce-8471-a3a5b6f29c0c-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.263994 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.263782 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18926691-cff6-45ce-8471-a3a5b6f29c0c-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:18.878593 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.878563 2565 generic.go:356] "Generic (PLEG): container finished" podID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerID="992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6" exitCode=0 Jul 08 03:57:18.878804 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.878615 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" Jul 08 03:57:18.878804 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.878657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerDied","Data":"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6"} Jul 08 03:57:18.878804 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.878707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c" event={"ID":"18926691-cff6-45ce-8471-a3a5b6f29c0c","Type":"ContainerDied","Data":"b8719863e9f970122330df0f5aaeae82f077bf9a56e620b2ca09b26fe4b6ce26"} Jul 08 03:57:18.878804 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.878732 2565 scope.go:117] "RemoveContainer" containerID="992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6" Jul 08 03:57:18.888038 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.888019 2565 scope.go:117] "RemoveContainer" containerID="8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15" Jul 08 03:57:18.896099 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.896080 2565 scope.go:117] "RemoveContainer" containerID="992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6" Jul 08 03:57:18.896384 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:18.896362 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6\": container with ID starting with 992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6 not found: ID does not exist" containerID="992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6" Jul 08 03:57:18.896455 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.896392 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6"} err="failed to get container status \"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6\": rpc error: code = NotFound desc = could not find container \"992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6\": container with ID starting with 992465d961791657e086e7c3e2b01eb879c20b71832a248801bdde5989d1d8f6 not found: ID does not exist" Jul 08 03:57:18.896455 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.896408 2565 scope.go:117] "RemoveContainer" containerID="8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15" Jul 08 03:57:18.896657 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:18.896624 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15\": container with ID starting with 8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15 not found: ID does not exist" containerID="8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15" Jul 08 03:57:18.896706 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.896663 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15"} err="failed to get container status \"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15\": rpc error: code = NotFound desc = could not find container \"8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15\": container with ID starting with 8c3c5906a2c8085ebb728e279bdbd582446a1012827ab9ea299a1984a862eb15 not found: ID does not exist" Jul 08 03:57:18.899156 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.899133 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:57:18.903100 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:18.903077 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-18addd-openshift-default-59b6cc7cf9-dg86c"] Jul 08 03:57:20.022194 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:20.022159 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" path="/var/lib/kubelet/pods/18926691-cff6-45ce-8471-a3a5b6f29c0c/volumes" Jul 08 03:57:24.884390 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884353 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884697 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884709 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884717 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884724 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884731 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884758 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884768 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:57:24.884783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884773 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:57:24.885016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884837 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:57:24.885016 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.884845 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:57:24.889539 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.889513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:24.892617 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.892592 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-42da32-openshift-default-dockercfg-v4xlh\"" Jul 08 03:57:24.905056 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:24.905020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:25.025129 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025299 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025299 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025299 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025299 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfhg\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.025475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.025467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126244 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126494 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfhg\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126837 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126837 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126837 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126904 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.126981 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.126970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.127442 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.127386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.128972 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.128948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.129076 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.129056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.134838 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.134774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfhg\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.134838 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.134774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token\") pod \"e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.200475 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.200409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:25.360202 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.360173 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:25.362011 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:57:25.361982 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefcf52e_8535_4dff_b9db_e2d26220242a.slice/crio-02eb289f06e1d07640bfeaeeefc132f611ec49e32d114c28407dc1a9a385104e WatchSource:0}: Error finding container 02eb289f06e1d07640bfeaeeefc132f611ec49e32d114c28407dc1a9a385104e: Status 404 returned error can't find the container with id 02eb289f06e1d07640bfeaeeefc132f611ec49e32d114c28407dc1a9a385104e Jul 08 03:57:25.364081 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.364047 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:25.364144 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.364124 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:25.364186 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.364173 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:25.911265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.911222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerStarted","Data":"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f"} Jul 08 03:57:25.911711 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.911287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerStarted","Data":"02eb289f06e1d07640bfeaeeefc132f611ec49e32d114c28407dc1a9a385104e"} Jul 08 03:57:25.935771 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:25.935719 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podStartSLOduration=1.935701031 podStartE2EDuration="1.935701031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:57:25.933192173 +0000 UTC m=+2236.458770293" watchObservedRunningTime="2026-07-08 03:57:25.935701031 +0000 UTC m=+2236.461279153" Jul 08 03:57:26.201072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:26.200967 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:26.206160 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:26.206131 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:26.916325 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:26.916290 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:26.917291 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:26.917270 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:39.972548 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.972512 2565 generic.go:356] "Generic (PLEG): container finished" podID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerID="c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f" exitCode=0 Jul 08 03:57:39.972997 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.972584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerDied","Data":"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f"} Jul 08 03:57:39.972997 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.972977 2565 scope.go:117] "RemoveContainer" containerID="c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f" Jul 08 03:57:39.973955 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.973926 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:39.974027 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.973995 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:39.974063 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:39.974028 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:57:40.978953 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:40.978916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerStarted","Data":"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf"} Jul 08 03:57:41.201179 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:41.201149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:41.202265 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:41.202234 2565 patch_prober.go:28] interesting pod/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 08 03:57:41.202414 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:41.202297 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 08 03:57:41.916359 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:41.916307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:42.200884 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:42.200790 2565 patch_prober.go:28] interesting pod/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 08 03:57:42.200884 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:42.200854 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 08 03:57:43.201042 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:43.201001 2565 patch_prober.go:28] interesting pod/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 08 03:57:43.201465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:43.201063 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 08 03:57:44.201850 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:44.201814 2565 patch_prober.go:28] interesting pod/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 08 03:57:44.202241 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:44.201882 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 08 03:57:45.204509 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:45.204476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:45.205497 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:45.205480 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:53.684189 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:53.684158 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:53.684595 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:53.684371 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" containerID="cri-o://64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf" gracePeriod=30 Jul 08 03:57:58.938082 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:58.938054 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:59.052828 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.052733 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.052828 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.052776 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.052855 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpfhg\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.052904 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.052957 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053025 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053049 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053072 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053074 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053122 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket\") pod \"fefcf52e-8535-4dff-b9db-e2d26220242a\" (UID: \"fefcf52e-8535-4dff-b9db-e2d26220242a\") " Jul 08 03:57:59.053356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053235 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:59.053356 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053255 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 03:57:59.053492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053417 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fefcf52e-8535-4dff-b9db-e2d26220242a-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.053492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053438 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.053492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053439 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:59.053492 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.053449 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:59.054190 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.054156 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:59.055677 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.055618 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 03:57:59.055677 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.055653 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:59.055869 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.055853 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 03:57:59.055869 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.055861 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg" (OuterVolumeSpecName: "kube-api-access-jpfhg") pod "fefcf52e-8535-4dff-b9db-e2d26220242a" (UID: "fefcf52e-8535-4dff-b9db-e2d26220242a"). InnerVolumeSpecName "kube-api-access-jpfhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 03:57:59.057038 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.057017 2565 generic.go:356] "Generic (PLEG): container finished" podID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerID="64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf" exitCode=0 Jul 08 03:57:59.057139 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.057070 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" Jul 08 03:57:59.057139 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.057106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerDied","Data":"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf"} Jul 08 03:57:59.057212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.057167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc" event={"ID":"fefcf52e-8535-4dff-b9db-e2d26220242a","Type":"ContainerDied","Data":"02eb289f06e1d07640bfeaeeefc132f611ec49e32d114c28407dc1a9a385104e"} Jul 08 03:57:59.057212 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.057196 2565 scope.go:117] "RemoveContainer" containerID="64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf" Jul 08 03:57:59.072173 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.072152 2565 scope.go:117] "RemoveContainer" containerID="c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f" Jul 08 03:57:59.080813 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.080791 2565 scope.go:117] "RemoveContainer" containerID="64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf" Jul 08 03:57:59.081101 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:59.081081 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf\": container with ID starting with 64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf not found: ID does not exist" containerID="64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf" Jul 08 03:57:59.081148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.081109 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf"} err="failed to get container status \"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf\": rpc error: code = NotFound desc = could not find container \"64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf\": container with ID starting with 64e73248202afa6e87e82e5fe73cbc67a659b1df3c8b32544a7e91836f5c43bf not found: ID does not exist" Jul 08 03:57:59.081148 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.081127 2565 scope.go:117] "RemoveContainer" containerID="c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f" Jul 08 03:57:59.081397 ip-10-0-140-212 kubenswrapper[2565]: E0708 03:57:59.081384 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f\": container with ID starting with c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f not found: ID does not exist" containerID="c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f" Jul 08 03:57:59.081437 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.081401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f"} err="failed to get container status \"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f\": rpc error: code = NotFound desc = could not find container \"c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f\": container with ID starting with c8b16a607f44a3c8e2320580e97febcac3ee8e0135b24c0149871ae81a08bc3f not found: ID does not exist" Jul 08 03:57:59.086679 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.086630 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:59.090555 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.090525 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-42da32-openshift-default-777bc7c85-fxsmc"] Jul 08 03:57:59.154140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154100 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154129 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154139 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154148 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154156 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fefcf52e-8535-4dff-b9db-e2d26220242a-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154441 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154164 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fefcf52e-8535-4dff-b9db-e2d26220242a-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:57:59.154441 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:57:59.154172 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpfhg\" (UniqueName: \"kubernetes.io/projected/fefcf52e-8535-4dff-b9db-e2d26220242a-kube-api-access-jpfhg\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 03:58:00.022976 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:00.022945 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" path="/var/lib/kubelet/pods/fefcf52e-8535-4dff-b9db-e2d26220242a/volumes" Jul 08 03:58:02.927625 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.927585 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 03:58:02.928083 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.928067 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 03:58:02.928140 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.928086 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 03:58:02.928195 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.928182 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceaa3417-2d48-4e56-823e-b0700707b855" containerName="istio-proxy" Jul 08 03:58:02.928237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.928198 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18926691-cff6-45ce-8471-a3a5b6f29c0c" containerName="istio-proxy" Jul 08 03:58:02.928237 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.928208 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 03:58:02.932843 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.932821 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.935598 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.935574 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b98412-openshift-default-dockercfg-752ln\"" Jul 08 03:58:02.943538 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.943499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 03:58:02.987026 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.986985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987240 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987441 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkl47\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987441 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:02.987441 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:02.987320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.088783 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.088747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.088998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.088790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.088998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.088828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.088998 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.088853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkl47\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089602 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.089848 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.090149 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.089875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.091312 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.091283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.091907 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.091887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.097859 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.097831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.097990 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.097915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkl47\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47\") pod \"e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.244112 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.244014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:03.393675 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.393611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 03:58:03.395969 ip-10-0-140-212 kubenswrapper[2565]: W0708 03:58:03.395940 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce512ae_ed70_43eb_883d_aa22dba14e7b.slice/crio-380e2c657f1e4d8155a4ff9c1e0394161f4cd5e692b9f6c6092749724f9d84cc WatchSource:0}: Error finding container 380e2c657f1e4d8155a4ff9c1e0394161f4cd5e692b9f6c6092749724f9d84cc: Status 404 returned error can't find the container with id 380e2c657f1e4d8155a4ff9c1e0394161f4cd5e692b9f6c6092749724f9d84cc Jul 08 03:58:03.398214 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.398178 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:03.398307 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.398291 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:03.398465 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:03.398334 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:04.080216 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:04.080178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerStarted","Data":"910edd097e4f61dec68f1bb6bddb22a0490900e6cad3e658593cdcf2d1ccd17f"} Jul 08 03:58:04.080659 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:04.080235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerStarted","Data":"380e2c657f1e4d8155a4ff9c1e0394161f4cd5e692b9f6c6092749724f9d84cc"} Jul 08 03:58:04.100654 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:04.100577 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podStartSLOduration=2.100559661 podStartE2EDuration="2.100559661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:58:04.100113508 +0000 UTC m=+2274.625691636" watchObservedRunningTime="2026-07-08 03:58:04.100559661 +0000 UTC m=+2274.626137783" Jul 08 03:58:04.244813 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:04.244758 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:04.249853 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:04.249825 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:05.084533 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:05.084501 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:05.085732 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:05.085713 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:19.160233 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.160187 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerID="910edd097e4f61dec68f1bb6bddb22a0490900e6cad3e658593cdcf2d1ccd17f" exitCode=0 Jul 08 03:58:19.160707 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.160260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerDied","Data":"910edd097e4f61dec68f1bb6bddb22a0490900e6cad3e658593cdcf2d1ccd17f"} Jul 08 03:58:19.160707 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.160664 2565 scope.go:117] "RemoveContainer" containerID="910edd097e4f61dec68f1bb6bddb22a0490900e6cad3e658593cdcf2d1ccd17f" Jul 08 03:58:19.161728 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.161695 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:19.161846 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.161780 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:19.161846 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:19.161829 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 03:58:20.084766 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:20.084724 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:20.165898 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:20.165860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerStarted","Data":"e511fabe5153ca21a0e6a5589801df16c1a3e390267d872b1220d37f4f89e919"} Jul 08 03:58:20.244264 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:20.244218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:20.245224 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:20.245199 2565 patch_prober.go:28] interesting pod/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 08 03:58:20.245349 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:20.245251 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 08 03:58:21.244834 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:21.244794 2565 patch_prober.go:28] interesting pod/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 08 03:58:21.245285 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:21.244858 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 08 03:58:22.244610 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:22.244566 2565 patch_prober.go:28] interesting pod/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 08 03:58:22.244835 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:22.244664 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 08 03:58:23.244903 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:23.244863 2565 patch_prober.go:28] interesting pod/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 08 03:58:23.245337 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:23.244925 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 08 03:58:24.248760 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:24.248730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:24.250288 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:24.250258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 03:58:24.254878 ip-10-0-140-212 kubenswrapper[2565]: I0708 03:58:24.254853 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 04:04:13.533409 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:13.533369 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 04:04:13.533950 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:13.533655 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" containerID="cri-o://e511fabe5153ca21a0e6a5589801df16c1a3e390267d872b1220d37f4f89e919" gracePeriod=30 Jul 08 04:04:18.670867 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.670833 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerID="e511fabe5153ca21a0e6a5589801df16c1a3e390267d872b1220d37f4f89e919" exitCode=0 Jul 08 04:04:18.671237 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.670888 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerDied","Data":"e511fabe5153ca21a0e6a5589801df16c1a3e390267d872b1220d37f4f89e919"} Jul 08 04:04:18.671237 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.670942 2565 scope.go:117] "RemoveContainer" containerID="910edd097e4f61dec68f1bb6bddb22a0490900e6cad3e658593cdcf2d1ccd17f" Jul 08 04:04:18.785149 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.785117 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 04:04:18.821133 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821040 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821133 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821080 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821133 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821133 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821154 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821182 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821218 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821277 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkl47\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821303 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo\") pod \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\" (UID: \"2ce512ae-ed70-43eb-883d-aa22dba14e7b\") " Jul 08 04:04:18.821477 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821437 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 04:04:18.821956 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821594 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-credential-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.821956 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821623 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 04:04:18.821956 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821592 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 04:04:18.821956 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.821880 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 04:04:18.822147 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.822107 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 04:04:18.823686 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.823629 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 04:04:18.824225 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.824203 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 04:04:18.824225 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.824210 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 04:04:18.824342 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.824329 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47" (OuterVolumeSpecName: "kube-api-access-nkl47") pod "2ce512ae-ed70-43eb-883d-aa22dba14e7b" (UID: "2ce512ae-ed70-43eb-883d-aa22dba14e7b"). InnerVolumeSpecName "kube-api-access-nkl47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 04:04:18.922235 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922200 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922235 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922228 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922235 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922238 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-envoy\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922483 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922246 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkl47\" (UniqueName: \"kubernetes.io/projected/2ce512ae-ed70-43eb-883d-aa22dba14e7b-kube-api-access-nkl47\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922483 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922257 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-podinfo\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922483 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922266 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istiod-ca-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922483 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922273 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-istio-data\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:18.922483 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:18.922282 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ce512ae-ed70-43eb-883d-aa22dba14e7b-workload-socket\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\"" Jul 08 04:04:19.676427 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.676400 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" Jul 08 04:04:19.676868 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.676398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5" event={"ID":"2ce512ae-ed70-43eb-883d-aa22dba14e7b","Type":"ContainerDied","Data":"380e2c657f1e4d8155a4ff9c1e0394161f4cd5e692b9f6c6092749724f9d84cc"} Jul 08 04:04:19.676868 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.676538 2565 scope.go:117] "RemoveContainer" containerID="e511fabe5153ca21a0e6a5589801df16c1a3e390267d872b1220d37f4f89e919" Jul 08 04:04:19.700164 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.700129 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 04:04:19.703737 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.703662 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b98412-openshift-default-c6cb54c59-dfwv5"] Jul 08 04:04:19.747066 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.747042 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4_c790f203-6488-438b-98bd-2306437a35d9/copy-manifests/0.log" Jul 08 04:04:19.760416 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:19.760385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4_c790f203-6488-438b-98bd-2306437a35d9/manager/0.log" Jul 08 04:04:20.022102 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:20.022015 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" path="/var/lib/kubelet/pods/2ce512ae-ed70-43eb-883d-aa22dba14e7b/volumes" Jul 08 04:04:22.444399 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:22.444368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789b5h6_e1294227-dc9a-4efe-af22-a775da3698f8/istio-proxy/0.log" Jul 08 04:04:22.560602 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:22.560564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dnw6d_0269cbd5-38b0-44bf-b537-ab350352d180/discovery/0.log" Jul 08 04:04:22.894745 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:22.894719 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/1.log" Jul 08 04:04:23.691577 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:23.691539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vn45w_b549199d-1115-4ec3-8885-7d8084f1a070/main/0.log" Jul 08 04:04:23.909402 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:23.909377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp56q7_d55e091e-3bd6-4c0d-9dbf-0bdfd5c917ec/main/0.log" Jul 08 04:04:24.017823 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:24.017737 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5q6mt_c8d2690c-b8fc-433f-b73b-ca48e9ac1812/main/0.log" Jul 08 04:04:30.739354 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:30.739323 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-csbvt_93ea0bd5-e962-49e5-8322-aed707e94ec0/global-pull-secret-syncer/0.log" Jul 08 04:04:30.955787 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:30.955757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vp52s_18bfbd1e-d404-4f91-a3c5-9de2118d0f40/konnectivity-agent/0.log" Jul 08 04:04:31.023395 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:31.023315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-212.ec2.internal_c149f1b9c7b961c6631e65b97b735994/haproxy/0.log" Jul 08 04:04:38.999532 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:38.999497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbqzw_da466125-d2d7-44b2-855d-e6d9808faa55/node-exporter/0.log" Jul 08 04:04:39.035779 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:39.035745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbqzw_da466125-d2d7-44b2-855d-e6d9808faa55/kube-rbac-proxy/0.log" Jul 08 04:04:39.088598 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:39.088567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbqzw_da466125-d2d7-44b2-855d-e6d9808faa55/init-textfile/0.log" Jul 08 04:04:39.229432 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:39.229399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xdp7f_a450924f-f662-4ecf-9724-5a5e1b01ec29/kube-rbac-proxy-main/0.log" Jul 08 04:04:39.261966 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:39.261877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xdp7f_a450924f-f662-4ecf-9724-5a5e1b01ec29/kube-rbac-proxy-self/0.log" Jul 08 04:04:39.283427 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:39.283401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xdp7f_a450924f-f662-4ecf-9724-5a5e1b01ec29/openshift-state-metrics/0.log" Jul 08 04:04:41.275057 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275020 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb"] Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275358 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275370 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275382 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275388 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275397 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275403 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275446 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ce512ae-ed70-43eb-883d-aa22dba14e7b" containerName="istio-proxy" Jul 08 04:04:41.275454 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.275452 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefcf52e-8535-4dff-b9db-e2d26220242a" containerName="istio-proxy" Jul 08 04:04:41.278628 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.278608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.281229 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.281206 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hvjg8\"/\"openshift-service-ca.crt\"" Jul 08 04:04:41.282386 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.282360 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hvjg8\"/\"default-dockercfg-w6npk\"" Jul 08 04:04:41.282507 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.282406 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hvjg8\"/\"kube-root-ca.crt\"" Jul 08 04:04:41.287058 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.287028 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb"] Jul 08 04:04:41.410566 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.410524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-proc\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.410783 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.410575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-podres\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.410783 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.410631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-sys\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.410783 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.410679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmpb\" (UniqueName: \"kubernetes.io/projected/82363794-3d47-4320-9514-b9a3e96d487c-kube-api-access-xlmpb\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.410783 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.410707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-lib-modules\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.511968 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.511927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-proc\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.511968 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.511970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-podres\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-sys\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmpb\" (UniqueName: \"kubernetes.io/projected/82363794-3d47-4320-9514-b9a3e96d487c-kube-api-access-xlmpb\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-lib-modules\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-sys\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512046 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-proc\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512207 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-podres\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.512401 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.512208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82363794-3d47-4320-9514-b9a3e96d487c-lib-modules\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.520985 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.520963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmpb\" (UniqueName: \"kubernetes.io/projected/82363794-3d47-4320-9514-b9a3e96d487c-kube-api-access-xlmpb\") pod \"perf-node-gather-daemonset-swxmb\" (UID: \"82363794-3d47-4320-9514-b9a3e96d487c\") " pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.589441 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.589346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:41.720320 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.720292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb"] Jul 08 04:04:41.722429 ip-10-0-140-212 kubenswrapper[2565]: W0708 04:04:41.722397 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod82363794_3d47_4320_9514_b9a3e96d487c.slice/crio-c760e6ad5f14adc7f275e6424affcae087b242efe6370ce6f0d38a7b8ba566bc WatchSource:0}: Error finding container c760e6ad5f14adc7f275e6424affcae087b242efe6370ce6f0d38a7b8ba566bc: Status 404 returned error can't find the container with id c760e6ad5f14adc7f275e6424affcae087b242efe6370ce6f0d38a7b8ba566bc Jul 08 04:04:41.771046 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:41.771015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" event={"ID":"82363794-3d47-4320-9514-b9a3e96d487c","Type":"ContainerStarted","Data":"c760e6ad5f14adc7f275e6424affcae087b242efe6370ce6f0d38a7b8ba566bc"} Jul 08 04:04:42.777623 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:42.777571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" event={"ID":"82363794-3d47-4320-9514-b9a3e96d487c","Type":"ContainerStarted","Data":"a641c522b8d842cf0a9fe1bfd1bb87055b098c1474845ba5f5fa766219c1dba5"} Jul 08 04:04:42.778038 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:42.777685 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:42.793518 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:42.793465 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" podStartSLOduration=1.793447861 podStartE2EDuration="1.793447861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:04:42.792328441 +0000 UTC m=+2673.317906564" watchObservedRunningTime="2026-07-08 04:04:42.793447861 +0000 UTC m=+2673.319025982" Jul 08 04:04:43.809459 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:43.809429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfsb5_d58ee91a-c5a9-49e7-a0db-ab50732d9a3c/dns/0.log" Jul 08 04:04:43.828826 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:43.828794 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfsb5_d58ee91a-c5a9-49e7-a0db-ab50732d9a3c/kube-rbac-proxy/0.log" Jul 08 04:04:43.946872 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:43.946847 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpbnb_87e9e6fb-7821-44c4-aa84-1b6df40c9d23/dns-node-resolver/0.log" Jul 08 04:04:44.472298 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:44.472268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56755d4cb9-tsx7q_09654b01-871b-4b5d-8ce2-6bad86cb45cd/registry/0.log" Jul 08 04:04:44.495319 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:44.495280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2vhbf_41bf7d5c-469c-4421-b943-93eed6810d58/node-ca/0.log" Jul 08 04:04:45.484999 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:45.484968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789b5h6_e1294227-dc9a-4efe-af22-a775da3698f8/istio-proxy/0.log" Jul 08 04:04:45.595670 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:45.595621 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dnw6d_0269cbd5-38b0-44bf-b537-ab350352d180/discovery/0.log" Jul 08 04:04:45.671435 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:45.671401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/0.log" Jul 08 04:04:45.700816 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:45.700784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/1.log" Jul 08 04:04:46.567710 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:46.567684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tft8h_e3d7e2eb-d73a-4aed-91d4-449a3db96494/serve-healthcheck-canary/0.log" Jul 08 04:04:47.126952 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:47.126924 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxwgk_fc84f4a9-96d4-4788-b1f5-5343d2361603/kube-rbac-proxy/0.log" Jul 08 04:04:47.149296 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:47.149271 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxwgk_fc84f4a9-96d4-4788-b1f5-5343d2361603/exporter/0.log" Jul 08 04:04:47.171154 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:47.171124 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxwgk_fc84f4a9-96d4-4788-b1f5-5343d2361603/extractor/0.log" Jul 08 04:04:48.793244 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:48.793215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hvjg8/perf-node-gather-daemonset-swxmb" Jul 08 04:04:50.097567 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:50.097532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4_c790f203-6488-438b-98bd-2306437a35d9/manager/0.log" Jul 08 04:04:50.115999 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:50.115967 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bfdfcb4c5-kp4l4_c790f203-6488-438b-98bd-2306437a35d9/copy-manifests/0.log" Jul 08 04:04:51.747035 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:51.747006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d464d4856-qn298_83574c06-1945-4dbb-a2c3-29a124443fda/manager/0.log" Jul 08 04:04:52.173128 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:52.173100 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789b5h6_e1294227-dc9a-4efe-af22-a775da3698f8/istio-proxy/0.log" Jul 08 04:04:52.273108 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:52.273069 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dnw6d_0269cbd5-38b0-44bf-b537-ab350352d180/discovery/0.log" Jul 08 04:04:52.321075 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:52.321045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/0.log" Jul 08 04:04:52.352644 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:52.352595 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/1.log" Jul 08 04:04:53.719669 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:53.719627 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789b5h6_e1294227-dc9a-4efe-af22-a775da3698f8/istio-proxy/0.log" Jul 08 04:04:53.824808 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:53.824782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dnw6d_0269cbd5-38b0-44bf-b537-ab350352d180/discovery/0.log" Jul 08 04:04:53.874293 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:53.874263 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/0.log" Jul 08 04:04:53.900619 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:53.900584 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7df7h_690b5357-0149-45ac-a769-b8d57d4e8f7c/istio-proxy/1.log" Jul 08 04:04:58.486969 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.486944 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/kube-multus-additional-cni-plugins/0.log" Jul 08 04:04:58.508443 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.508416 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/egress-router-binary-copy/0.log" Jul 08 04:04:58.529132 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.529107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/cni-plugins/0.log" Jul 08 04:04:58.550112 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.550084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/bond-cni-plugin/0.log" Jul 08 04:04:58.571031 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.571004 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/routeoverride-cni/0.log" Jul 08 04:04:58.594778 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.594745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/whereabouts-cni-bincopy/0.log" Jul 08 04:04:58.615991 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.615958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htkbm_35a8a8a2-5fc9-40ee-a5fd-158261cf1c1f/whereabouts-cni/0.log" Jul 08 04:04:58.797338 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.797259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pg4p5_9b4921f6-8955-48ed-95bf-aaa79cd44fa7/kube-multus/0.log" Jul 08 04:04:58.960251 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.960222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzzs4_65ac74a9-81b4-499f-ad6c-9d9a4e72421f/network-metrics-daemon/0.log" Jul 08 04:04:58.982742 ip-10-0-140-212 kubenswrapper[2565]: I0708 04:04:58.982707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzzs4_65ac74a9-81b4-499f-ad6c-9d9a4e72421f/kube-rbac-proxy/0.log"