Jul 06 21:11:01.537549 ip-10-0-142-144 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 21:11:01.537563 ip-10-0-142-144 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 21:11:01.537573 ip-10-0-142-144 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 21:11:01.537878 ip-10-0-142-144 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 21:11:11.631752 ip-10-0-142-144 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 21:11:11.631772 ip-10-0-142-144 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9b0a57b9374a4fd18d2622f96ee27c4c -- Jul 06 21:13:07.176717 ip-10-0-142-144 systemd[1]: Starting Kubernetes Kubelet... Jul 06 21:13:07.534185 ip-10-0-142-144 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:13:07.534185 ip-10-0-142-144 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 21:13:07.534185 ip-10-0-142-144 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:13:07.534185 ip-10-0-142-144 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 21:13:07.534185 ip-10-0-142-144 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:13:07.535710 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.535631 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543663 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543679 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543683 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543687 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543689 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543693 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.543686 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543695 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543699 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543701 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543704 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543707 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543711 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543715 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543718 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543720 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543723 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543725 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543728 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543730 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543736 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543739 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543741 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543744 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543746 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543749 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.543955 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543751 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543754 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543756 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543759 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543761 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543764 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543766 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543768 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543771 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543775 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543779 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543783 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543787 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543789 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543792 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543795 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543798 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543800 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543803 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.544517 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543805 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543808 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543810 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543813 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543815 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543818 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543821 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543824 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543827 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543829 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543832 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543834 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543837 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543839 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543841 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543844 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543846 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543848 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543851 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543853 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.545067 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543855 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543858 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543860 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543863 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543865 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543868 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543870 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543873 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543876 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543879 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543881 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543884 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543886 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543889 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543894 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543897 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543899 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543902 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543905 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543908 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.545746 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543911 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543914 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543916 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543919 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543921 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543923 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543926 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543928 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543931 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543934 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543936 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543938 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543941 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543943 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.543946 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544679 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544688 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544692 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544695 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544698 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.546306 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544702 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544705 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544708 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544711 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544714 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544716 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544719 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544721 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544724 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544726 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544728 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544731 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544734 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544737 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544740 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544742 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544744 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544747 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544749 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544752 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.546872 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544754 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544756 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544759 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544761 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544764 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544766 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544768 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544771 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544774 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544776 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544781 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544784 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544788 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544791 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544794 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544796 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544799 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544801 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544804 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.547444 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544807 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544809 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544811 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544814 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544816 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544819 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544822 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544824 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544827 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544829 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544831 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544834 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544836 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544839 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544841 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544843 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544846 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544848 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544851 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544853 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.547974 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544855 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544860 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544863 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544866 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544868 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544871 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544873 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544876 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544878 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544880 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544883 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544885 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544888 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544890 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544892 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544895 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544897 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544899 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544902 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.548486 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544904 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544907 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544909 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544912 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544915 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544918 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544920 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544923 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544925 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544929 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544932 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544935 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544937 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544940 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.544943 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545303 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545308 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545312 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545314 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.548998 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545317 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545320 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545323 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545325 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545328 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545331 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545333 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545336 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545338 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545340 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545343 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545345 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545348 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545350 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545353 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545355 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545357 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545360 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545362 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545364 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.549496 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545367 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545369 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545372 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545374 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545378 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545381 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545386 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545389 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545391 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545394 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545397 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545399 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545401 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545406 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545409 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545428 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545431 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545433 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545436 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.550012 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545438 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545441 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545444 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545446 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545448 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545451 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545454 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545456 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545459 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545461 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545464 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545466 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545468 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545471 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545473 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545475 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545478 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545480 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545482 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545486 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.550490 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545489 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545491 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545493 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545496 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545499 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545501 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545504 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545506 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545509 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545511 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545513 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545516 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545518 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545523 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545526 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545528 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545531 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545533 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545536 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.550977 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545538 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545541 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545544 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545546 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545548 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545551 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545553 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545555 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545558 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545560 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545563 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545565 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545569 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545571 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545574 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545576 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.545579 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545645 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545652 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545658 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545670 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 21:13:07.551491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545674 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545677 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545680 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545684 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545687 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545690 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545693 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545696 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545699 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545702 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545706 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545709 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545712 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545715 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545718 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545721 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545724 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545726 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545730 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545733 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545736 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545739 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545742 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545746 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 21:13:07.552004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545749 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545752 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545755 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545758 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545761 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545764 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545767 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545770 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545772 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545775 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545779 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545782 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545784 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545787 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545790 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545793 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545795 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545799 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545806 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545809 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545811 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545815 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545818 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545820 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545823 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 21:13:07.552600 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545826 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545829 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545832 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545835 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545838 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545840 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545844 2581 flags.go:64] FLAG: --help="false" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545847 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545850 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545853 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545855 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545858 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545861 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545864 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545867 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545869 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545872 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545874 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545877 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545880 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545883 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545885 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545888 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545891 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 21:13:07.553269 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545893 2581 flags.go:64] FLAG: --lock-file="" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545897 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545900 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545903 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545908 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545911 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545913 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545916 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545919 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545922 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545924 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545927 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545931 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545933 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545937 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545942 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545944 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545947 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545950 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545953 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545956 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545958 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545965 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545968 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545971 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 21:13:07.553880 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545974 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545976 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545981 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545984 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545987 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545989 2581 flags.go:64] FLAG: --port="10250" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545992 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545995 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099aba74bb2d57f5f" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.545999 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546002 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546005 2581 flags.go:64] FLAG: --register-node="true" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546008 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546011 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546014 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546017 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546020 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546023 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546026 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546029 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546031 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546034 2581 flags.go:64] FLAG: --runonce="false" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546037 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546040 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546043 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546045 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 21:13:07.554539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546048 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546051 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546054 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546057 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546059 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546062 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546064 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546067 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546070 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546072 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546075 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546080 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546082 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546085 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546088 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546092 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546094 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546097 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546100 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546102 2581 flags.go:64] FLAG: --v="2" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546106 2581 flags.go:64] FLAG: --version="false" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546110 2581 flags.go:64] FLAG: --vmodule="" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546113 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546116 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546219 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.555137 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546222 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546225 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546228 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546230 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546233 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546235 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546238 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546240 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546242 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546245 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546247 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546250 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546252 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546255 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546257 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546259 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546262 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546264 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546267 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546269 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.555761 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546272 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546274 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546278 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546280 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546282 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546286 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546289 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546292 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546294 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546297 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546301 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546304 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546308 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546311 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546313 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546316 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546318 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546321 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546324 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.556240 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546326 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546329 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546331 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546333 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546336 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546338 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546341 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546343 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546346 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546348 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546351 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546353 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546355 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546358 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546360 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546364 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546366 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546368 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546371 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.556757 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546373 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546376 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546378 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546380 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546386 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546388 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546391 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546394 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546396 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546399 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546401 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546404 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546407 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546409 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546425 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546428 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546430 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546433 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546436 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546438 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.557238 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546441 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546443 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546447 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546450 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546453 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546456 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546459 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546461 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546465 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546468 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546471 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546473 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546476 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546478 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546481 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546483 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546487 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546490 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546492 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.557735 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.546495 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.546500 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.552992 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.553011 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.553816 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.553823 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553878 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553883 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553887 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553889 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553892 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553895 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553898 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553902 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553904 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.558198 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553907 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553910 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553913 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553916 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553919 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553921 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553924 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553926 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553929 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553931 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553934 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553937 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553939 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553943 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553947 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553951 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553953 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553956 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553959 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.558672 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553962 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553966 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553969 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553971 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553975 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553977 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553980 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553982 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553985 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553987 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553990 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553992 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553994 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553997 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.553999 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554001 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554004 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554006 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554009 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554011 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.559134 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554013 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554016 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554018 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554021 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554024 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554026 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554029 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554031 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554034 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554042 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554045 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554047 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554050 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554053 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554055 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554058 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554060 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554063 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554065 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.559629 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554068 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554070 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554073 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554075 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554078 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554080 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554082 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554085 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554088 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554090 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554093 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554095 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554098 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554100 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554102 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554105 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554107 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554110 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554112 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.560102 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554115 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554118 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554122 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554125 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554132 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554135 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554137 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554142 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554145 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554148 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554151 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554153 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554156 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.554161 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554266 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:13:07.560576 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554269 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554272 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554275 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554278 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554280 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554283 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554285 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554288 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554290 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554293 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554296 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554299 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554301 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554303 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554306 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554308 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554311 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554313 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554316 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554318 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:13:07.560960 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554320 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554323 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554326 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554328 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554331 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554334 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554337 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554340 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554343 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554345 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554349 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554352 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554354 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554357 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554359 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554362 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554364 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554367 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554369 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:13:07.561613 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554371 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554374 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554376 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554379 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554381 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554383 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554386 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554388 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554390 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554393 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554395 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554397 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554400 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554402 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554405 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554407 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554426 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554430 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554433 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:13:07.562237 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554435 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554438 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554440 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554443 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554446 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554449 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554452 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554455 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554458 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554460 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554463 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554466 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554468 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554471 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554474 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554477 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554479 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554482 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554484 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:13:07.562721 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554487 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554489 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554491 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554494 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554496 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554499 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554501 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554503 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554505 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554508 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554510 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554516 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554521 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554523 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554526 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554528 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554531 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554533 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554536 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:13:07.563218 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554538 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:07.554540 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.554546 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.554633 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.556468 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.557699 2581 server.go:1019] "Starting client certificate rotation" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.557799 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.557843 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.560141 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:13:07.563732 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.561217 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:13:07.576461 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.576439 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 21:13:07.578862 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.578840 2581 log.go:25] "Validated CRI v1 image API" Jul 06 21:13:07.579589 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.579574 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 21:13:07.581739 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.581719 2581 fs.go:135] Filesystem UUIDs: map[0a38142d-c68b-4ddc-afd4-9e715c4e19eb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f68b4d76-3496-438c-acf5-504fec6713c3:/dev/nvme0n1p4] Jul 06 21:13:07.581822 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.581738 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 21:13:07.586533 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.586403 2581 manager.go:216] Machine: {Timestamp:2026-07-06 21:13:07.585300712 +0000 UTC m=+0.305067752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100136 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238c6c3a554c6fac81968c67454963 SystemUUID:ec238c6c-3a55-4c6f-ac81-968c67454963 BootID:9b0a57b9-374a-4fd1-8d26-22f96ee27c4c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:d5:f2:ee:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:d5:f2:ee:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:ba:9d:ef:84:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 21:13:07.586533 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.586526 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 21:13:07.586693 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.586625 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 21:13:07.587573 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.587555 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:13:07.587697 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.587666 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 21:13:07.587854 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.587702 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 21:13:07.588354 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.588342 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 21:13:07.588408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.588361 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 21:13:07.588408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.588371 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:13:07.589004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.588991 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:13:07.590330 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.590317 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 21:13:07.593473 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593459 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:13:07.593603 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593592 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 21:13:07.593668 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593634 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 21:13:07.593668 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593654 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 21:13:07.593756 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593673 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 21:13:07.593756 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593686 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 21:13:07.593756 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.593700 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 21:13:07.594058 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.594044 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:13:07.594118 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.594067 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:13:07.596110 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.596095 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 21:13:07.597724 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.597708 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 21:13:07.597796 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.597746 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 21:13:07.598675 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598662 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598681 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598689 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598698 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598710 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598718 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598729 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 21:13:07.598737 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598737 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 21:13:07.598999 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598746 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 21:13:07.598999 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598754 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 21:13:07.598999 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598773 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 21:13:07.598999 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.598781 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 21:13:07.599475 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.599463 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 21:13:07.599523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.599478 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 21:13:07.602709 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.602573 2581 server.go:1268] "Started kubelet" Jul 06 21:13:07.602801 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.602681 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 21:13:07.602801 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.602761 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 21:13:07.602801 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.602668 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 21:13:07.603611 ip-10-0-142-144 systemd[1]: Started Kubernetes Kubelet. Jul 06 21:13:07.604518 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.604498 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 21:13:07.604741 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.604713 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 21:13:07.607616 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.604733 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 21:13:07.608351 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.608324 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 21:13:07.608948 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.608925 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 21:13:07.609324 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.609307 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 21:13:07.609567 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.609546 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rzcfc" Jul 06 21:13:07.611469 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.609756 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-144.ec2.internal.18bfcfbce14a4ae7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-144.ec2.internal,UID:ip-10-0-142-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-144.ec2.internal,},FirstTimestamp:2026-07-06 21:13:07.602549479 +0000 UTC m=+0.322316519,LastTimestamp:2026-07-06 21:13:07.602549479 +0000 UTC m=+0.322316519,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-144.ec2.internal,}" Jul 06 21:13:07.613669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.613647 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 21:13:07.613747 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.613735 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 21:13:07.613797 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.613745 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:07.614302 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614220 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 21:13:07.614372 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614353 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 21:13:07.614372 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614367 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 21:13:07.614516 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614502 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 21:13:07.614516 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614517 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 21:13:07.614624 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614605 2581 factory.go:55] Registering systemd factory Jul 06 21:13:07.614624 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614624 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 21:13:07.614876 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614866 2581 factory.go:153] Registering CRI-O factory Jul 06 21:13:07.614876 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614878 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 21:13:07.614956 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614915 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 21:13:07.614956 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614938 2581 factory.go:103] Registering Raw factory Jul 06 21:13:07.614956 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.614951 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 21:13:07.615286 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.615271 2581 manager.go:349] Starting recovery of all containers Jul 06 21:13:07.615872 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.615850 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 21:13:07.616358 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.616331 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 21:13:07.618849 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.617552 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rzcfc" Jul 06 21:13:07.625136 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.625120 2581 manager.go:354] Recovery completed Jul 06 21:13:07.629773 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.629761 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.631639 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.631624 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.631703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.631654 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.631703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.631667 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.632119 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632100 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 21:13:07.632119 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632119 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 21:13:07.632228 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632137 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:13:07.632228 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632111 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.632809 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632796 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.632867 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632821 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.632867 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.632830 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.633100 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.633087 2581 policy_none.go:49] "None policy: Start" Jul 06 21:13:07.633151 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.633112 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 21:13:07.633151 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.633126 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 21:13:07.634065 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.634051 2581 policy_none.go:47] "Start" Jul 06 21:13:07.666933 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.666920 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 21:13:07.667030 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.666988 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 21:13:07.667030 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667002 2581 server.go:87] "Starting device plugin registration server" Jul 06 21:13:07.667223 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667211 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 21:13:07.667287 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667224 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 21:13:07.667333 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667320 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 21:13:07.667717 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667434 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 21:13:07.667717 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.667447 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 21:13:07.668109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.668093 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 21:13:07.668161 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.668135 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:07.767878 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.767845 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.769039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.768822 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.769039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.768848 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.769039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.768858 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.769039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.768878 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.774907 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.774893 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.774961 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.774913 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-144.ec2.internal\": node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:07.783202 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.783185 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:07.798514 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.798462 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 21:13:07.799702 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.799687 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 21:13:07.799769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.799731 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 21:13:07.799769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.799755 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 21:13:07.799868 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.799792 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 21:13:07.801532 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.801512 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:07.883604 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.883575 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:07.900731 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.900714 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal"] Jul 06 21:13:07.900783 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.900779 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.901662 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.901648 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.901708 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.901677 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.901708 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.901687 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.902996 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.902984 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.903132 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.903168 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903147 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.903713 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903691 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.903713 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903704 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.903824 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903721 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.903824 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903725 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.903824 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903731 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.903824 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.903736 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.904887 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.904870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.904955 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.904897 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:13:07.905747 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.905730 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:13:07.905825 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.905760 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:13:07.905825 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.905770 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:13:07.915453 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.915436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.915524 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.915460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.915524 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:07.915478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f554e2b8de4942207b69bb5df078360-config\") pod \"kube-apiserver-proxy-ip-10-0-142-144.ec2.internal\" (UID: \"2f554e2b8de4942207b69bb5df078360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.933012 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.932995 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-144.ec2.internal\" not found" node="ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.936350 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.936333 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-144.ec2.internal\" not found" node="ip-10-0-142-144.ec2.internal" Jul 06 21:13:07.984098 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:07.984078 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.016454 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.016537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016451 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.016537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f554e2b8de4942207b69bb5df078360-config\") pod \"kube-apiserver-proxy-ip-10-0-142-144.ec2.internal\" (UID: \"2f554e2b8de4942207b69bb5df078360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.016537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.016537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f554e2b8de4942207b69bb5df078360-config\") pod \"kube-apiserver-proxy-ip-10-0-142-144.ec2.internal\" (UID: \"2f554e2b8de4942207b69bb5df078360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.016537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.016530 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b14e6cdbc81539fdf89e4bd7f5a99a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal\" (UID: \"b14e6cdbc81539fdf89e4bd7f5a99a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.084716 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.084664 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.185272 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.185248 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.235705 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.235688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.239705 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.239671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:08.285684 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.285663 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.386212 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.386134 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.486633 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.486589 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.554957 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.554933 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:08.556985 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.556970 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 21:13:08.557083 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.557066 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 21:13:08.587293 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.587267 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.619774 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.619741 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 21:08:07 +0000 UTC" deadline="2028-01-02 20:29:48.081160979 +0000 UTC" Jul 06 21:13:08.619774 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.619767 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13079h16m39.461398797s" Jul 06 21:13:08.688065 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.687999 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.731792 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.731772 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:08.788427 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.788388 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.830917 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:08.830889 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f554e2b8de4942207b69bb5df078360.slice/crio-e9281b741a239bb615f3d7a5d2b1a8a6350393a9027fca1a91c077037d3f8f54 WatchSource:0}: Error finding container e9281b741a239bb615f3d7a5d2b1a8a6350393a9027fca1a91c077037d3f8f54: Status 404 returned error can't find the container with id e9281b741a239bb615f3d7a5d2b1a8a6350393a9027fca1a91c077037d3f8f54 Jul 06 21:13:08.831264 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:08.831245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14e6cdbc81539fdf89e4bd7f5a99a19.slice/crio-6e491de3bdd4065e498b140a3f626b4c10e751a433c2cc4509b9c040b31a6637 WatchSource:0}: Error finding container 6e491de3bdd4065e498b140a3f626b4c10e751a433c2cc4509b9c040b31a6637: Status 404 returned error can't find the container with id 6e491de3bdd4065e498b140a3f626b4c10e751a433c2cc4509b9c040b31a6637 Jul 06 21:13:08.835573 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.835554 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:13:08.888779 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:08.888754 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-144.ec2.internal\" not found" Jul 06 21:13:08.936376 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:08.936352 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:09.014460 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.014381 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" Jul 06 21:13:09.025556 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.025540 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:13:09.026362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.026350 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" Jul 06 21:13:09.037959 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.037942 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:13:09.595137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.595107 2581 apiserver.go:52] "Watching apiserver" Jul 06 21:13:09.604782 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.604611 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 21:13:09.606925 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.606605 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-c264f","openshift-multus/multus-s7r88","openshift-ovn-kubernetes/ovnkube-node-ntgf2","kube-system/global-pull-secret-syncer-h6rxc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6","openshift-cluster-node-tuning-operator/tuned-2z8n9","openshift-image-registry/node-ca-5t2fs","openshift-multus/network-metrics-daemon-lwdvx","openshift-network-diagnostics/network-check-target-2qm4x","openshift-network-operator/iptables-alerter-xbsss","kube-system/konnectivity-agent-q8jx7","kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal","openshift-dns/node-resolver-f7lmx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal"] Jul 06 21:13:09.608826 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.608801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.611513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.611471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.612456 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.612291 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.612456 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.612311 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 21:13:09.612456 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.612412 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.612740 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.612568 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-thztn\"" Jul 06 21:13:09.614202 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.614182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.614381 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.614364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.614637 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.614618 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 21:13:09.615682 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.615658 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.615785 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.615710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wrczr\"" Jul 06 21:13:09.616039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.616018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.616135 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.616113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:09.616965 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.616944 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.617393 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.617372 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.617652 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.617634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 21:13:09.617652 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.617643 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 21:13:09.617830 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.617811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7rm8s\"" Jul 06 21:13:09.618818 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.618588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.618919 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.618813 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 21:13:09.619284 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.619261 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 21:13:09.620251 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.620232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.621511 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.621467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 21:13:09.621613 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.621602 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9hx8t\"" Jul 06 21:13:09.621825 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.621808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:09.621895 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.621872 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:09.622000 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.621983 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.622219 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.622201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.622877 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.622853 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.623323 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.623302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.623620 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.623599 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qq67k\"" Jul 06 21:13:09.624096 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.623920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.625697 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-var-lib-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625794 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-node-log\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625794 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-config\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625794 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-env-overrides\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-kubelet-config\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-dbus\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-systemd-units\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-log-socket\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-bin\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.625961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad30afc-572b-4aac-9c31-3914527929d8-serviceca\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j852j\" (UniqueName: \"kubernetes.io/projected/d84793ef-dc6b-422d-a1ea-52f7b2e73264-kube-api-access-j852j\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.625994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-netd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gps\" (UniqueName: \"kubernetes.io/projected/49addfd0-6f4b-4337-8088-bdf0e067cab7-kube-api-access-n2gps\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad30afc-572b-4aac-9c31-3914527929d8-host\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgrt4\" (UniqueName: \"kubernetes.io/projected/aad30afc-572b-4aac-9c31-3914527929d8-kube-api-access-mgrt4\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-kubelet\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-script-lib\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d84793ef-dc6b-422d-a1ea-52f7b2e73264-hosts-file\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626218 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-netns\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-ovn\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626276 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovn-node-metrics-cert\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84793ef-dc6b-422d-a1ea-52f7b2e73264-tmp-dir\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-systemd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-etc-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-slash\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.626871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.627189 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 21:13:09.627189 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.626997 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 21:13:09.627278 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d4qxs\"" Jul 06 21:13:09.627278 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627248 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.627278 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.627425 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627289 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.627663 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627649 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 21:13:09.627745 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.627731 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:13:09.628670 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.628649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.630218 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.629950 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 21:13:09.630218 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.630116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ln4tj\"" Jul 06 21:13:09.630393 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.630355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.631230 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.631271 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.631531 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.631682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j2htp\"" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.631976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.632398 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.632085 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:09.633661 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.633640 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 21:13:09.633781 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.633695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zftbz\"" Jul 06 21:13:09.633845 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.633643 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 21:13:09.652811 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.652787 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxrr7" Jul 06 21:13:09.662272 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.662249 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxrr7" Jul 06 21:13:09.715589 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.715564 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 21:13:09.726914 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.726882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-systemd-units\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727017 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.726929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-log-socket\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727017 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.726959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cnibin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727017 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.726985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-k8s-cni-cncf-io\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727017 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-systemd\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-log-socket\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-systemd-units\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a21f674c-e464-4034-aef4-1216e70c2a2c-agent-certs\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-netd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-multus\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-netd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-kubelet\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-multus-certs\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb6fd\" (UniqueName: \"kubernetes.io/projected/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-kube-api-access-hb6fd\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-kubernetes\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad30afc-572b-4aac-9c31-3914527929d8-host\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-os-release\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad30afc-572b-4aac-9c31-3914527929d8-host\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cni-binary-copy\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727596 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-host\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-tmp\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfk25\" (UniqueName: \"kubernetes.io/projected/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-kube-api-access-kfk25\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgrt4\" (UniqueName: \"kubernetes.io/projected/aad30afc-572b-4aac-9c31-3914527929d8-kube-api-access-mgrt4\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-kubelet\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-script-lib\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-socket-dir-parent\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727814 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-kubelet\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-netns\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.727927 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-systemd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.727982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-bin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-hostroot\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-systemd\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-modprobe-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-conf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-run-netns\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a21f674c-e464-4034-aef4-1216e70c2a2c-konnectivity-ca\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-tuned\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-node-log\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-dbus\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.728305 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:09.728748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysconfig\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-script-lib\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728393 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-dbus\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.728370 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:10.228350049 +0000 UTC m=+2.948117093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-bin\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-run\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpmf\" (UniqueName: \"kubernetes.io/projected/bcbd5dfe-172b-428f-9139-e88ccf639f38-kube-api-access-gwpmf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6cd6\" (UniqueName: \"kubernetes.io/projected/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-kube-api-access-w6cd6\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66sc\" (UniqueName: \"kubernetes.io/projected/a33a77bd-9220-404c-807b-9667cbeb2ac5-kube-api-access-s66sc\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-cni-bin\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad30afc-572b-4aac-9c31-3914527929d8-serviceca\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j852j\" (UniqueName: \"kubernetes.io/projected/d84793ef-dc6b-422d-a1ea-52f7b2e73264-kube-api-access-j852j\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gps\" (UniqueName: \"kubernetes.io/projected/49addfd0-6f4b-4337-8088-bdf0e067cab7-kube-api-access-n2gps\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.728746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.729604 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729147 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad30afc-572b-4aac-9c31-3914527929d8-serviceca\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-host-slash\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-sys\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729294 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-node-log\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-system-cni-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-daemon-config\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-lib-modules\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d84793ef-dc6b-422d-a1ea-52f7b2e73264-hosts-file\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-ovn\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovn-node-metrics-cert\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-netns\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-run-ovn\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-os-release\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.730361 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84793ef-dc6b-422d-a1ea-52f7b2e73264-tmp-dir\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-etc-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7hv\" (UniqueName: \"kubernetes.io/projected/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kube-api-access-ph7hv\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-system-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-etc-kubernetes\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cnibin\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-slash\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-conf-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-var-lib-kubelet\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-iptables-alerter-script\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729916 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-var-lib-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d84793ef-dc6b-422d-a1ea-52f7b2e73264-tmp-dir\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-etc-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-host-slash\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731120 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d84793ef-dc6b-422d-a1ea-52f7b2e73264-hosts-file\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.729935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/49addfd0-6f4b-4337-8088-bdf0e067cab7-var-lib-openvswitch\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-config\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-env-overrides\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-kubelet-config\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.730598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.731091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-env-overrides\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.731100 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovnkube-config\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.731865 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.731163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f752983e-067d-41f7-8349-11d0e9387c12-kubelet-config\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:09.733447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.733204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/49addfd0-6f4b-4337-8088-bdf0e067cab7-ovn-node-metrics-cert\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.744795 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.744776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gps\" (UniqueName: \"kubernetes.io/projected/49addfd0-6f4b-4337-8088-bdf0e067cab7-kube-api-access-n2gps\") pod \"ovnkube-node-ntgf2\" (UID: \"49addfd0-6f4b-4337-8088-bdf0e067cab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.745188 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.745162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j852j\" (UniqueName: \"kubernetes.io/projected/d84793ef-dc6b-422d-a1ea-52f7b2e73264-kube-api-access-j852j\") pod \"node-resolver-f7lmx\" (UID: \"d84793ef-dc6b-422d-a1ea-52f7b2e73264\") " pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.745873 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.745844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgrt4\" (UniqueName: \"kubernetes.io/projected/aad30afc-572b-4aac-9c31-3914527929d8-kube-api-access-mgrt4\") pod \"node-ca-5t2fs\" (UID: \"aad30afc-572b-4aac-9c31-3914527929d8\") " pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.804387 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.804332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" event={"ID":"2f554e2b8de4942207b69bb5df078360","Type":"ContainerStarted","Data":"e9281b741a239bb615f3d7a5d2b1a8a6350393a9027fca1a91c077037d3f8f54"} Jul 06 21:13:09.805674 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.805630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" event={"ID":"b14e6cdbc81539fdf89e4bd7f5a99a19","Type":"ContainerStarted","Data":"6e491de3bdd4065e498b140a3f626b4c10e751a433c2cc4509b9c040b31a6637"} Jul 06 21:13:09.831477 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.831610 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.831610 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.831610 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-host-slash\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.831610 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-sys\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-host-slash\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-system-cni-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.831721 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831730 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-sys\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.831769 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.831767 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:10.331749592 +0000 UTC m=+3.051516621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-system-cni-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831798 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-daemon-config\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-lib-modules\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-netns\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-os-release\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-lib-modules\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-netns\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.831992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7hv\" (UniqueName: \"kubernetes.io/projected/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kube-api-access-ph7hv\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-system-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-etc-kubernetes\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cnibin\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-etc-kubernetes\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832215 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832261 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cnibin\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832317 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-system-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-os-release\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-conf-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-var-lib-kubelet\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-conf-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-iptables-alerter-script\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-daemon-config\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-var-lib-kubelet\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cnibin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-k8s-cni-cncf-io\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.832798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-systemd\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a21f674c-e464-4034-aef4-1216e70c2a2c-agent-certs\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cnibin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-multus\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-systemd\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-kubelet\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-multus\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-multus-certs\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb6fd\" (UniqueName: \"kubernetes.io/projected/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-kube-api-access-hb6fd\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-kubernetes\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-kubelet\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-k8s-cni-cncf-io\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-os-release\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cni-binary-copy\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-iptables-alerter-script\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-run-multus-certs\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.833471 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.832968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-host\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-tmp\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-kubernetes\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfk25\" (UniqueName: \"kubernetes.io/projected/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-kube-api-access-kfk25\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-socket-dir-parent\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-bin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-hostroot\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833268 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-cni-dir\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-modprobe-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-conf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a21f674c-e464-4034-aef4-1216e70c2a2c-konnectivity-ca\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-tuned\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-os-release\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.834314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-modprobe-d\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833414 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-host\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-hostroot\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysconfig\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-multus-socket-dir-parent\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-host-var-lib-cni-bin\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-run\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833510 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysctl-conf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpmf\" (UniqueName: \"kubernetes.io/projected/bcbd5dfe-172b-428f-9139-e88ccf639f38-kube-api-access-gwpmf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-run\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6cd6\" (UniqueName: \"kubernetes.io/projected/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-kube-api-access-w6cd6\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.833616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66sc\" (UniqueName: \"kubernetes.io/projected/a33a77bd-9220-404c-807b-9667cbeb2ac5-kube-api-access-s66sc\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.834559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-sysconfig\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.835162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.834607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-cni-binary-copy\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.835948 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.835377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a21f674c-e464-4034-aef4-1216e70c2a2c-konnectivity-ca\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.836039 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.836016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-tmp\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.838317 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.837211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a21f674c-e464-4034-aef4-1216e70c2a2c-agent-certs\") pod \"konnectivity-agent-q8jx7\" (UID: \"a21f674c-e464-4034-aef4-1216e70c2a2c\") " pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:09.838317 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.837551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd5dfe-172b-428f-9139-e88ccf639f38-etc-tuned\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.846302 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.846226 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7hv\" (UniqueName: \"kubernetes.io/projected/6dba42c9-b10e-40ea-99f7-a1760ca8f6c9-kube-api-access-ph7hv\") pod \"aws-ebs-csi-driver-node-rjdt6\" (UID: \"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.847567 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.847543 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb6fd\" (UniqueName: \"kubernetes.io/projected/7eeed2a5-9a29-4eff-9a60-5c16c08b536d-kube-api-access-hb6fd\") pod \"multus-s7r88\" (UID: \"7eeed2a5-9a29-4eff-9a60-5c16c08b536d\") " pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.849432 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.849384 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:09.849432 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.849414 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:09.849432 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.849429 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:09.849687 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:09.849575 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:10.349553527 +0000 UTC m=+3.069320579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:09.852080 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.852052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66sc\" (UniqueName: \"kubernetes.io/projected/a33a77bd-9220-404c-807b-9667cbeb2ac5-kube-api-access-s66sc\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:09.852574 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.852541 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfk25\" (UniqueName: \"kubernetes.io/projected/d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e-kube-api-access-kfk25\") pod \"iptables-alerter-xbsss\" (UID: \"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e\") " pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.852965 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.852941 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6cd6\" (UniqueName: \"kubernetes.io/projected/e02e9f18-e04e-44f5-9802-705a4f0a6c4a-kube-api-access-w6cd6\") pod \"multus-additional-cni-plugins-c264f\" (UID: \"e02e9f18-e04e-44f5-9802-705a4f0a6c4a\") " pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.853508 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.853490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpmf\" (UniqueName: \"kubernetes.io/projected/bcbd5dfe-172b-428f-9139-e88ccf639f38-kube-api-access-gwpmf\") pod \"tuned-2z8n9\" (UID: \"bcbd5dfe-172b-428f-9139-e88ccf639f38\") " pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.924838 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.924809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5t2fs" Jul 06 21:13:09.940200 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.940176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f7lmx" Jul 06 21:13:09.943841 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.943819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c264f" Jul 06 21:13:09.951735 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.951716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:09.958447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.958408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" Jul 06 21:13:09.967219 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.967202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" Jul 06 21:13:09.976135 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.976116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7r88" Jul 06 21:13:09.983061 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.983041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbsss" Jul 06 21:13:09.990675 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:09.990655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:10.095522 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.095490 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:13:10.237200 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.237121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:10.237326 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.237274 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:10.237378 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.237338 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:11.237321644 +0000 UTC m=+3.957088672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:10.338381 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.338351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:10.338555 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.338474 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:10.338555 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.338525 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:11.338511045 +0000 UTC m=+4.058278072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:10.438997 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.438961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:10.439190 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.439167 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:10.439241 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.439197 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:10.439241 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.439212 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:10.439335 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.439279 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:11.439258122 +0000 UTC m=+4.159025178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:10.666394 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.666282 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:08:09 +0000 UTC" deadline="2027-12-24 03:50:09.161821733 +0000 UTC" Jul 06 21:13:10.666394 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.666340 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12846h36m58.495486241s" Jul 06 21:13:10.766855 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.766829 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49addfd0_6f4b_4337_8088_bdf0e067cab7.slice/crio-c40b9ce8545541dcd61b6548b89c0ee225a3b834970b018a6099eb4b25694fe6 WatchSource:0}: Error finding container c40b9ce8545541dcd61b6548b89c0ee225a3b834970b018a6099eb4b25694fe6: Status 404 returned error can't find the container with id c40b9ce8545541dcd61b6548b89c0ee225a3b834970b018a6099eb4b25694fe6 Jul 06 21:13:10.768789 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.768529 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbd5dfe_172b_428f_9139_e88ccf639f38.slice/crio-729b74398e6f8db7aa9933621d3a4c91e72ec6c92bcaa5482b21090af4c4e333 WatchSource:0}: Error finding container 729b74398e6f8db7aa9933621d3a4c91e72ec6c92bcaa5482b21090af4c4e333: Status 404 returned error can't find the container with id 729b74398e6f8db7aa9933621d3a4c91e72ec6c92bcaa5482b21090af4c4e333 Jul 06 21:13:10.772694 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.772672 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21f674c_e464_4034_aef4_1216e70c2a2c.slice/crio-b9e60191442e3d2a46d1b43e2252e83c7b8b61659cd395b0f7729bf804d34c99 WatchSource:0}: Error finding container b9e60191442e3d2a46d1b43e2252e83c7b8b61659cd395b0f7729bf804d34c99: Status 404 returned error can't find the container with id b9e60191442e3d2a46d1b43e2252e83c7b8b61659cd395b0f7729bf804d34c99 Jul 06 21:13:10.774313 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.774165 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84793ef_dc6b_422d_a1ea_52f7b2e73264.slice/crio-6dd43a59e9e72d296c22fc85fca37e071febd0ece831d067432bbf0c69887389 WatchSource:0}: Error finding container 6dd43a59e9e72d296c22fc85fca37e071febd0ece831d067432bbf0c69887389: Status 404 returned error can't find the container with id 6dd43a59e9e72d296c22fc85fca37e071febd0ece831d067432bbf0c69887389 Jul 06 21:13:10.775038 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.775010 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dba42c9_b10e_40ea_99f7_a1760ca8f6c9.slice/crio-4708fa39b542634963f50b8fae02926fcc24386185898d4419c14a9c48ecf449 WatchSource:0}: Error finding container 4708fa39b542634963f50b8fae02926fcc24386185898d4419c14a9c48ecf449: Status 404 returned error can't find the container with id 4708fa39b542634963f50b8fae02926fcc24386185898d4419c14a9c48ecf449 Jul 06 21:13:10.780397 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.776958 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02e9f18_e04e_44f5_9802_705a4f0a6c4a.slice/crio-037cb2a32abc7291254c885071b9292e9db436ee3fa1e6e46722ae57b4798209 WatchSource:0}: Error finding container 037cb2a32abc7291254c885071b9292e9db436ee3fa1e6e46722ae57b4798209: Status 404 returned error can't find the container with id 037cb2a32abc7291254c885071b9292e9db436ee3fa1e6e46722ae57b4798209 Jul 06 21:13:10.780397 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.777613 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad30afc_572b_4aac_9c31_3914527929d8.slice/crio-dd0068f6e458d88dcee5e631860eaadba2e79f0e9aee2d8abccf9fc4bfe23de3 WatchSource:0}: Error finding container dd0068f6e458d88dcee5e631860eaadba2e79f0e9aee2d8abccf9fc4bfe23de3: Status 404 returned error can't find the container with id dd0068f6e458d88dcee5e631860eaadba2e79f0e9aee2d8abccf9fc4bfe23de3 Jul 06 21:13:10.780397 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:10.778826 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32c1e27_25c5_4cc1_bb21_c0dbcfa0639e.slice/crio-478b7e62e4e8078305a7140dd1164b01b9c2e46cdf20315095e8ff0ca9362ba6 WatchSource:0}: Error finding container 478b7e62e4e8078305a7140dd1164b01b9c2e46cdf20315095e8ff0ca9362ba6: Status 404 returned error can't find the container with id 478b7e62e4e8078305a7140dd1164b01b9c2e46cdf20315095e8ff0ca9362ba6 Jul 06 21:13:10.800752 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.800731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:10.800854 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:10.800836 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:10.812447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.812401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbsss" event={"ID":"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e","Type":"ContainerStarted","Data":"478b7e62e4e8078305a7140dd1164b01b9c2e46cdf20315095e8ff0ca9362ba6"} Jul 06 21:13:10.814483 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.814460 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerStarted","Data":"037cb2a32abc7291254c885071b9292e9db436ee3fa1e6e46722ae57b4798209"} Jul 06 21:13:10.815440 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.815417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f7lmx" event={"ID":"d84793ef-dc6b-422d-a1ea-52f7b2e73264","Type":"ContainerStarted","Data":"6dd43a59e9e72d296c22fc85fca37e071febd0ece831d067432bbf0c69887389"} Jul 06 21:13:10.816547 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.816523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q8jx7" event={"ID":"a21f674c-e464-4034-aef4-1216e70c2a2c","Type":"ContainerStarted","Data":"b9e60191442e3d2a46d1b43e2252e83c7b8b61659cd395b0f7729bf804d34c99"} Jul 06 21:13:10.817620 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.817600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" event={"ID":"bcbd5dfe-172b-428f-9139-e88ccf639f38","Type":"ContainerStarted","Data":"729b74398e6f8db7aa9933621d3a4c91e72ec6c92bcaa5482b21090af4c4e333"} Jul 06 21:13:10.818576 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.818558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7r88" event={"ID":"7eeed2a5-9a29-4eff-9a60-5c16c08b536d","Type":"ContainerStarted","Data":"3d5ad27de68e0c3404e6ebe41d23dcb5f48a48f7d8b25bc7766200e47e7db555"} Jul 06 21:13:10.819525 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.819505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5t2fs" event={"ID":"aad30afc-572b-4aac-9c31-3914527929d8","Type":"ContainerStarted","Data":"dd0068f6e458d88dcee5e631860eaadba2e79f0e9aee2d8abccf9fc4bfe23de3"} Jul 06 21:13:10.820558 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.820526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" event={"ID":"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9","Type":"ContainerStarted","Data":"4708fa39b542634963f50b8fae02926fcc24386185898d4419c14a9c48ecf449"} Jul 06 21:13:10.821670 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:10.821649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"c40b9ce8545541dcd61b6548b89c0ee225a3b834970b018a6099eb4b25694fe6"} Jul 06 21:13:11.246169 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.246106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:11.246353 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.246339 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:11.246429 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.246403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:13.246384742 +0000 UTC m=+5.966151773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:11.347499 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.346862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:11.347499 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.347016 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:11.347499 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.347078 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:13.347059155 +0000 UTC m=+6.066826192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:11.448373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.447763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:11.448373 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.447939 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:11.448373 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.447958 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:11.448373 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.447971 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:11.448373 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.448029 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:13.448008438 +0000 UTC m=+6.167775469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:11.667540 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.667396 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:08:09 +0000 UTC" deadline="2028-02-02 12:13:36.734449209 +0000 UTC" Jul 06 21:13:11.667540 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.667473 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13815h0m25.066979669s" Jul 06 21:13:11.805162 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.804679 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:11.805162 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.804803 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:11.805409 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.805177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:11.805409 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:11.805312 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:11.854125 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.853481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" event={"ID":"2f554e2b8de4942207b69bb5df078360","Type":"ContainerStarted","Data":"bcfbd12bec6b9b4448b63078107d5a413ef1d3b08afc019ab29cc20a109b4162"} Jul 06 21:13:11.870954 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.870896 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-144.ec2.internal" podStartSLOduration=2.870875893 podStartE2EDuration="2.870875893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:11.870163715 +0000 UTC m=+4.589930770" watchObservedRunningTime="2026-07-06 21:13:11.870875893 +0000 UTC m=+4.590642948" Jul 06 21:13:11.873199 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.873172 2581 generic.go:356] "Generic (PLEG): container finished" podID="b14e6cdbc81539fdf89e4bd7f5a99a19" containerID="eb6124c4e877e3be852af6613889b610b1d0248bf139881396501732b1aa154e" exitCode=0 Jul 06 21:13:11.873317 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:11.873217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" event={"ID":"b14e6cdbc81539fdf89e4bd7f5a99a19","Type":"ContainerDied","Data":"eb6124c4e877e3be852af6613889b610b1d0248bf139881396501732b1aa154e"} Jul 06 21:13:12.800755 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:12.800721 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:12.801208 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:12.800857 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:12.885569 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:12.885501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" event={"ID":"b14e6cdbc81539fdf89e4bd7f5a99a19","Type":"ContainerStarted","Data":"4ac62003cc07f42a8275fa3dff986e77e96c9144110264dbc50a8bd3566bc3f6"} Jul 06 21:13:13.268601 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:13.268524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:13.268751 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.268722 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:13.268847 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.268788 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:17.268767788 +0000 UTC m=+9.988534820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:13.370075 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:13.370018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:13.370262 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.370174 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:13.370262 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.370234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:17.370214432 +0000 UTC m=+10.089981462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:13.471072 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:13.471027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:13.471307 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.471274 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:13.471307 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.471301 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:13.471494 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.471314 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:13.471494 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.471368 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:17.471350359 +0000 UTC m=+10.191117400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:13.802939 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:13.802904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:13.803373 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.803044 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:13.803489 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:13.803438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:13.804005 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:13.803976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:14.800365 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:14.800335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:14.800560 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:14.800472 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:15.800239 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:15.800150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:15.800673 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:15.800282 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:15.800673 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:15.800598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:15.800798 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:15.800690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:16.800503 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:16.800015 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:16.800503 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:16.800148 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:17.302121 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:17.301640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:17.302121 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.301798 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:17.302121 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.301846 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:25.301832623 +0000 UTC m=+18.021599652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:17.402893 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:17.402852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:17.403056 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.403025 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:17.403109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.403085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:25.403068923 +0000 UTC m=+18.122835952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:17.503564 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:17.503533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:17.503772 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.503720 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:17.503772 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.503750 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:17.503772 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.503764 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:17.503959 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.503817 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:25.503800767 +0000 UTC m=+18.223567805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:17.809335 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:17.809303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:17.809720 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:17.809333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:17.809720 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.809487 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:17.809720 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:17.809603 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:18.801100 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:18.800655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:18.801100 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:18.800779 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:19.802574 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:19.802116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:19.802574 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:19.802241 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:19.803118 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:19.802675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:19.803118 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:19.802799 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:20.800288 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:20.800259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:20.800482 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:20.800373 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:21.800192 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:21.800158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:21.800698 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:21.800205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:21.800698 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:21.800312 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:21.800698 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:21.800405 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:22.800119 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:22.800091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:22.800292 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:22.800209 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:23.800265 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:23.800230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:23.800440 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:23.800344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:23.800798 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:23.800429 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:23.800798 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:23.800534 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:24.800727 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:24.800696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:24.801146 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:24.800796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:25.368482 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:25.368456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:25.368636 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.368571 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:25.368636 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.368617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:41.368604047 +0000 UTC m=+34.088371074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:25.469393 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:25.469363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:25.469541 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.469475 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:25.469541 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.469520 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:41.469506681 +0000 UTC m=+34.189273707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:25.570586 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:25.570552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:25.570727 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.570710 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:25.570813 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.570732 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:25.570813 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.570741 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:25.570813 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.570790 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:41.570774166 +0000 UTC m=+34.290541195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:25.800552 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:25.800471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:25.800552 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:25.800496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:25.800765 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.800609 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:25.800765 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:25.800699 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:26.800770 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:26.800597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:26.801145 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:26.800850 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:27.801252 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:27.801215 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:27.801711 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:27.801358 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:27.801711 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:27.801393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:27.801711 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:27.801523 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:28.800167 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:28.800136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:28.800340 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:28.800251 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:29.801033 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.801009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:29.801599 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:29.801120 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:29.801599 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.801255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:29.801599 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:29.801352 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:29.919584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.919425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q8jx7" event={"ID":"a21f674c-e464-4034-aef4-1216e70c2a2c","Type":"ContainerStarted","Data":"a67eb98c31be38d60975cc10650d29ef1234a799b6b17594373f2c4d9b29599f"} Jul 06 21:13:29.924703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.923967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" event={"ID":"bcbd5dfe-172b-428f-9139-e88ccf639f38","Type":"ContainerStarted","Data":"99e88c46087cdfb9d5a7e72dfe69a1026e232ff9518c2357014ade80c189e378"} Jul 06 21:13:29.938660 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.937580 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-144.ec2.internal" podStartSLOduration=20.93756236 podStartE2EDuration="20.93756236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:12.902099189 +0000 UTC m=+5.621866238" watchObservedRunningTime="2026-07-06 21:13:29.93756236 +0000 UTC m=+22.657329410" Jul 06 21:13:29.938660 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.938493 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q8jx7" podStartSLOduration=11.063684661 podStartE2EDuration="21.938478336s" totalImagesPullingTime="10.874793675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:29.937327371 +0000 UTC m=+22.657094420" watchObservedRunningTime="2026-07-06 21:13:29.938478336 +0000 UTC m=+22.658245384" Jul 06 21:13:29.984643 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.984395 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2z8n9" podStartSLOduration=3.018522967 podStartE2EDuration="21.984379202s" totalImagesPullingTime="18.965856235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:29.964881445 +0000 UTC m=+22.684648493" watchObservedRunningTime="2026-07-06 21:13:29.984379202 +0000 UTC m=+22.704146251" Jul 06 21:13:29.985098 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:29.985063 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s7r88" podStartSLOduration=2.9679536090000003 podStartE2EDuration="21.985053009s" totalImagesPullingTime="19.0170994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:29.984264232 +0000 UTC m=+22.704031281" watchObservedRunningTime="2026-07-06 21:13:29.985053009 +0000 UTC m=+22.704820056" Jul 06 21:13:30.800753 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.800727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:30.800892 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:30.800825 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:30.937616 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.937581 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="a6265779841cc6c31fcd443b530da3ec25524719e976ff1efcbc0a7cc76fa5a6" exitCode=0 Jul 06 21:13:30.938229 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.937661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"a6265779841cc6c31fcd443b530da3ec25524719e976ff1efcbc0a7cc76fa5a6"} Jul 06 21:13:30.939456 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.939166 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f7lmx" event={"ID":"d84793ef-dc6b-422d-a1ea-52f7b2e73264","Type":"ContainerStarted","Data":"60ab9dd17221d012fda147b6a235bea965c832d20ab981ede23ecb70ff466e9a"} Jul 06 21:13:30.940723 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.940706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7r88" event={"ID":"7eeed2a5-9a29-4eff-9a60-5c16c08b536d","Type":"ContainerStarted","Data":"bf3b3299ce1dea3bc4c9c582505e1f704724afbeef30b9e07ab6c00386948ddb"} Jul 06 21:13:30.942171 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.942153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5t2fs" event={"ID":"aad30afc-572b-4aac-9c31-3914527929d8","Type":"ContainerStarted","Data":"a8e06bd7c42739a47c9d84dd5ceba29fa396ab6b37f175e49e80f5cb57aa95f3"} Jul 06 21:13:30.943512 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.943493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" event={"ID":"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9","Type":"ContainerStarted","Data":"b7a8288840de4dd1b1f3bf539ac950f75987487b6968073bde8f9c2673b88eec"} Jul 06 21:13:30.946280 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"56725e8c70676cffff835a9145b4301ec239db162b0a367adb04a93f81aaa589"} Jul 06 21:13:30.946359 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"102c99c4544b353b5b2e3e13ee8a9c299bfcf73b04e4a33e55db5ebfbe2383ab"} Jul 06 21:13:30.946359 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"1cc4316f2fb5c7080250a66fb22289a9904d308f712a5773f7ea17b344f409ff"} Jul 06 21:13:30.946466 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"0422c89a7388c77424cc8535bef23d473c75eb4eba15ab74d37d206ead5e800b"} Jul 06 21:13:30.946466 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"02b0f20d72c4b7846e12661caec4056aa56e8ccb57df554ad99f623cdbec8836"} Jul 06 21:13:30.946466 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.946438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"8f68b050feaf550a7dbf30ec8fa37e9be0cefd9dba3023a34203eff45450df72"} Jul 06 21:13:30.980478 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.980443 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f7lmx" podStartSLOduration=4.020500508 podStartE2EDuration="22.980431789s" totalImagesPullingTime="18.959931281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:30.980282255 +0000 UTC m=+23.700049304" watchObservedRunningTime="2026-07-06 21:13:30.980431789 +0000 UTC m=+23.700198834" Jul 06 21:13:30.997775 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:30.997737 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5t2fs" podStartSLOduration=4.041732177 podStartE2EDuration="22.997726866s" totalImagesPullingTime="18.955994689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:30.997131464 +0000 UTC m=+23.716898514" watchObservedRunningTime="2026-07-06 21:13:30.997726866 +0000 UTC m=+23.717493913" Jul 06 21:13:31.082766 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.082722 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 21:13:31.682111 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.681592 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T21:13:31.082741001Z","UUID":"88922534-455a-4d36-a836-9331c935a44b","Handler":null,"Name":"","Endpoint":""} Jul 06 21:13:31.683729 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.683709 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 21:13:31.683874 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.683748 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 21:13:31.800106 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.800072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:31.800280 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.800116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:31.800280 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:31.800222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:31.800398 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:31.800354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:31.951132 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.951053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" event={"ID":"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9","Type":"ContainerStarted","Data":"3288b59e3c27ca17defc9a0a66c64e96666e713337ad9becb369e5a634f93e6f"} Jul 06 21:13:31.952995 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.952967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbsss" event={"ID":"d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e","Type":"ContainerStarted","Data":"418508f3d7a91274648b0f40d56e3a213243059f2716c3018ca1009a0a245578"} Jul 06 21:13:31.969351 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:31.969309 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xbsss" podStartSLOduration=5.015321783 podStartE2EDuration="23.969288924s" totalImagesPullingTime="18.953967141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:31.968767982 +0000 UTC m=+24.688535030" watchObservedRunningTime="2026-07-06 21:13:31.969288924 +0000 UTC m=+24.689055973" Jul 06 21:13:32.800531 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.800454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:32.800678 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:32.800580 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:32.928843 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.928807 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:32.929454 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.929431 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:32.957428 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.957377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" event={"ID":"6dba42c9-b10e-40ea-99f7-a1760ca8f6c9","Type":"ContainerStarted","Data":"9e96c399cdd9e864783a6145a20593a16196e8b2742290adef333c7cceb6038c"} Jul 06 21:13:32.961215 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.961179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"81efd0366a01d7b4d2d61c41927fdc19d0b126e335e864a2cb2927fe7b7ef831"} Jul 06 21:13:32.986506 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:32.986458 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjdt6" podStartSLOduration=3.904816588 podStartE2EDuration="24.986440185s" totalImagesPullingTime="21.081623597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:32.985874629 +0000 UTC m=+25.705641687" watchObservedRunningTime="2026-07-06 21:13:32.986440185 +0000 UTC m=+25.706207234" Jul 06 21:13:33.800838 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:33.800810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:33.801015 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:33.800925 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:33.801015 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:33.800980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:33.801136 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:33.801089 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:34.800688 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.800648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:34.801326 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:34.800774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:34.972319 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.972086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" event={"ID":"49addfd0-6f4b-4337-8088-bdf0e067cab7","Type":"ContainerStarted","Data":"caec511c9ac5f5b4f34bf159ad424166a426e9acdfde3fb74872dca5b1df2bc3"} Jul 06 21:13:34.973847 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.973738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:34.973847 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.973813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:34.973955 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.973863 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:34.997470 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.997442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:34.997608 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:34.997594 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:13:35.006603 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:35.006556 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" podStartSLOduration=7.971572411 podStartE2EDuration="27.006539638s" totalImagesPullingTime="19.034967227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:35.006322312 +0000 UTC m=+27.726089371" watchObservedRunningTime="2026-07-06 21:13:35.006539638 +0000 UTC m=+27.726306689" Jul 06 21:13:35.800696 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:35.800658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:35.801272 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:35.800784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:35.801272 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:35.800831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:35.801272 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:35.800927 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:35.975556 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:35.975475 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="2d29fd5fc8a78e8d6a2fbb28873a7df32470ebb5834431472ee3618114516b5b" exitCode=0 Jul 06 21:13:35.975720 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:35.975557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"2d29fd5fc8a78e8d6a2fbb28873a7df32470ebb5834431472ee3618114516b5b"} Jul 06 21:13:36.287597 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:36.287519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:36.287787 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:36.287647 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 21:13:36.288182 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:36.288081 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q8jx7" Jul 06 21:13:36.800033 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:36.800012 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:36.800222 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:36.800108 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:37.095829 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.095656 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6rxc"] Jul 06 21:13:37.096251 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.095909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:37.096251 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:37.096013 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:37.099805 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.099778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2qm4x"] Jul 06 21:13:37.099910 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.099876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:37.099981 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:37.099957 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:37.100523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.100240 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwdvx"] Jul 06 21:13:37.100523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.100351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:37.100523 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:37.100489 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:37.981936 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.981900 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="19129924d398bd4b2f9e0da52e4a6166e67be0717c93baf821eebc9a095d024c" exitCode=0 Jul 06 21:13:37.982156 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:37.981948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"19129924d398bd4b2f9e0da52e4a6166e67be0717c93baf821eebc9a095d024c"} Jul 06 21:13:38.800974 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:38.800938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:38.801513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:38.801001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:38.801513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:38.801018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:38.801513 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:38.801113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:38.801513 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:38.801199 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:38.801513 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:38.801231 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:39.987689 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:39.987658 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="0695e3364296eeb176c8e663ba102e42902f46bd024556a0fc5e598be5b08c18" exitCode=0 Jul 06 21:13:39.988226 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:39.987701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"0695e3364296eeb176c8e663ba102e42902f46bd024556a0fc5e598be5b08c18"} Jul 06 21:13:40.800888 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:40.800855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:40.801069 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:40.800968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:40.801069 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:40.800978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:40.801069 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:40.800977 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6rxc" podUID="f752983e-067d-41f7-8349-11d0e9387c12" Jul 06 21:13:40.801235 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:40.801080 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwdvx" podUID="a33a77bd-9220-404c-807b-9667cbeb2ac5" Jul 06 21:13:40.801235 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:40.801160 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2qm4x" podUID="b748545b-ec14-4b8a-b053-78b128c2515e" Jul 06 21:13:41.392566 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:41.392536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:41.392988 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.392706 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:41.392988 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.392786 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret podName:f752983e-067d-41f7-8349-11d0e9387c12 nodeName:}" failed. No retries permitted until 2026-07-06 21:14:13.392765514 +0000 UTC m=+66.112532543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret") pod "global-pull-secret-syncer-h6rxc" (UID: "f752983e-067d-41f7-8349-11d0e9387c12") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:13:41.493174 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:41.493149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:41.493346 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.493256 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:41.493346 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.493317 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs podName:a33a77bd-9220-404c-807b-9667cbeb2ac5 nodeName:}" failed. No retries permitted until 2026-07-06 21:14:13.493301676 +0000 UTC m=+66.213068712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs") pod "network-metrics-daemon-lwdvx" (UID: "a33a77bd-9220-404c-807b-9667cbeb2ac5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:13:41.594255 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:41.594221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:41.594399 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.594348 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:13:41.594399 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.594365 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:13:41.594399 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.594374 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhgm2 for pod openshift-network-diagnostics/network-check-target-2qm4x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:41.594540 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:41.594500 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2 podName:b748545b-ec14-4b8a-b053-78b128c2515e nodeName:}" failed. No retries permitted until 2026-07-06 21:14:13.594404928 +0000 UTC m=+66.314171954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgm2" (UniqueName: "kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2") pod "network-check-target-2qm4x" (UID: "b748545b-ec14-4b8a-b053-78b128c2515e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:13:42.620450 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.620193 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-144.ec2.internal" event="NodeReady" Jul 06 21:13:42.620896 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.620504 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 21:13:42.665571 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.665539 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l6q28"] Jul 06 21:13:42.667914 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.667890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.670733 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.670704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 21:13:42.671352 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.671130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4w8fd\"" Jul 06 21:13:42.671352 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.671148 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 21:13:42.673035 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.673002 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hwvqm"] Jul 06 21:13:42.674931 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.674913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.677790 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.677771 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 21:13:42.677884 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.677789 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 21:13:42.677945 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.677884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spnsv\"" Jul 06 21:13:42.678004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.677979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 21:13:42.678055 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.678048 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 21:13:42.681722 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.681402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6q28"] Jul 06 21:13:42.693439 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.690600 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hwvqm"] Jul 06 21:13:42.693439 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.690828 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zzxlf"] Jul 06 21:13:42.699243 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.699217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.703053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.702661 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 21:13:42.703053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.702704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kccmm\"" Jul 06 21:13:42.703053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.702741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 21:13:42.703053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.702964 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 21:13:42.703053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.703006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzxlf"] Jul 06 21:13:42.800876 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.800841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:13:42.801031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.800894 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:13:42.801031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.801026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:13:42.803894 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.803874 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:13:42.803997 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.803971 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kz87d\"" Jul 06 21:13:42.804168 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.804153 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:13:42.804205 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.804167 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:13:42.804392 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.804346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:13:42.804392 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.804388 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2dbc\"" Jul 06 21:13:42.805592 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-cert\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.805686 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70a946f-97d2-4dea-bb54-056f2777aa6e-tmp-dir\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.805686 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbfvb\" (UniqueName: \"kubernetes.io/projected/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-api-access-vbfvb\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.805773 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.805773 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.805773 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70a946f-97d2-4dea-bb54-056f2777aa6e-config-volume\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.805905 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6df7c\" (UniqueName: \"kubernetes.io/projected/f70a946f-97d2-4dea-bb54-056f2777aa6e-kube-api-access-6df7c\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.805905 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.805986 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzs6\" (UniqueName: \"kubernetes.io/projected/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-kube-api-access-jlzs6\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.805986 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.805956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f03e4bc0-a048-46d9-bfe8-112993b9bc79-data-volume\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.806081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.806028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f03e4bc0-a048-46d9-bfe8-112993b9bc79-crio-socket\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.906645 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.906645 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.906645 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70a946f-97d2-4dea-bb54-056f2777aa6e-config-volume\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.906645 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6df7c\" (UniqueName: \"kubernetes.io/projected/f70a946f-97d2-4dea-bb54-056f2777aa6e-kube-api-access-6df7c\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.906915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.906915 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.906702 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:13:42.906915 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.906781 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:43.406760379 +0000 UTC m=+36.126527404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : configmap "kube-rbac-proxy" not found Jul 06 21:13:42.906915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzs6\" (UniqueName: \"kubernetes.io/projected/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-kube-api-access-jlzs6\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.907081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f03e4bc0-a048-46d9-bfe8-112993b9bc79-data-volume\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.907081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.906973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f03e4bc0-a048-46d9-bfe8-112993b9bc79-crio-socket\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.907081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-cert\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.907081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70a946f-97d2-4dea-bb54-056f2777aa6e-tmp-dir\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.907081 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbfvb\" (UniqueName: \"kubernetes.io/projected/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-api-access-vbfvb\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.907263 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.907111 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:13:42.907263 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.907167 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:43.407150905 +0000 UTC m=+36.126917932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : secret "insights-runtime-extractor-tls" not found Jul 06 21:13:42.907353 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f70a946f-97d2-4dea-bb54-056f2777aa6e-config-volume\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.907447 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.906708 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:42.907505 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:42.907447 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls podName:f70a946f-97d2-4dea-bb54-056f2777aa6e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:43.407431455 +0000 UTC m=+36.127198495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls") pod "dns-default-l6q28" (UID: "f70a946f-97d2-4dea-bb54-056f2777aa6e") : secret "dns-default-metrics-tls" not found Jul 06 21:13:42.907505 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f03e4bc0-a048-46d9-bfe8-112993b9bc79-crio-socket\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.907700 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f70a946f-97d2-4dea-bb54-056f2777aa6e-tmp-dir\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:42.907807 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.907716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f03e4bc0-a048-46d9-bfe8-112993b9bc79-data-volume\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.911894 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.911875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-cert\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.915940 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.915914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbfvb\" (UniqueName: \"kubernetes.io/projected/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-api-access-vbfvb\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:42.916166 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.916151 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzs6\" (UniqueName: \"kubernetes.io/projected/5c343d6c-6ded-404b-886d-4aabb6dcf0a7-kube-api-access-jlzs6\") pod \"ingress-canary-zzxlf\" (UID: \"5c343d6c-6ded-404b-886d-4aabb6dcf0a7\") " pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:42.916533 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:42.916511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6df7c\" (UniqueName: \"kubernetes.io/projected/f70a946f-97d2-4dea-bb54-056f2777aa6e-kube-api-access-6df7c\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:43.009031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.009000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzxlf" Jul 06 21:13:43.009187 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.009102 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f7lmx_d84793ef-dc6b-422d-a1ea-52f7b2e73264/dns-node-resolver/0.log" Jul 06 21:13:43.410796 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.410767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:43.410961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.410809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:43.410961 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.410879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:43.410961 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.410896 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:13:43.411109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.410965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:44.41094677 +0000 UTC m=+37.130713800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : configmap "kube-rbac-proxy" not found Jul 06 21:13:43.411109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.410999 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:13:43.411109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.411036 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:43.411109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.411056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:44.411038787 +0000 UTC m=+37.130805818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : secret "insights-runtime-extractor-tls" not found Jul 06 21:13:43.411109 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:43.411089 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls podName:f70a946f-97d2-4dea-bb54-056f2777aa6e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:44.411078525 +0000 UTC m=+37.130845550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls") pod "dns-default-l6q28" (UID: "f70a946f-97d2-4dea-bb54-056f2777aa6e") : secret "dns-default-metrics-tls" not found Jul 06 21:13:43.781725 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.781645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5t2fs_aad30afc-572b-4aac-9c31-3914527929d8/node-ca/0.log" Jul 06 21:13:43.807696 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.807668 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hkzlp"] Jul 06 21:13:43.809538 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.809520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:43.812459 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.812436 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 21:13:43.812693 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.812672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 21:13:43.812876 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.812862 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 21:13:43.813804 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.813777 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 21:13:43.813912 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.813826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s4qfq\"" Jul 06 21:13:43.820849 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.820828 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hkzlp"] Jul 06 21:13:43.915194 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.915161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-key\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:43.915353 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.915266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2znfn\" (UniqueName: \"kubernetes.io/projected/dbd1e08f-be14-47b4-a559-4e8ff098c94e-kube-api-access-2znfn\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:43.915353 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:43.915314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-cabundle\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.016221 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.016196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-key\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.016345 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.016299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znfn\" (UniqueName: \"kubernetes.io/projected/dbd1e08f-be14-47b4-a559-4e8ff098c94e-kube-api-access-2znfn\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.016406 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.016358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-cabundle\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.017056 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.017023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-cabundle\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.019010 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.018988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbd1e08f-be14-47b4-a559-4e8ff098c94e-signing-key\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.025633 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.025611 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2znfn\" (UniqueName: \"kubernetes.io/projected/dbd1e08f-be14-47b4-a559-4e8ff098c94e-kube-api-access-2znfn\") pod \"service-ca-758f599c5-hkzlp\" (UID: \"dbd1e08f-be14-47b4-a559-4e8ff098c94e\") " pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.120671 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.120639 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hkzlp" Jul 06 21:13:44.141330 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.141143 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzxlf"] Jul 06 21:13:44.143255 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:44.143233 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c343d6c_6ded_404b_886d_4aabb6dcf0a7.slice/crio-34eaea0251f4b39ae8ffc572a9f8fa8ba27c9f6300de9a294233f19613401e67 WatchSource:0}: Error finding container 34eaea0251f4b39ae8ffc572a9f8fa8ba27c9f6300de9a294233f19613401e67: Status 404 returned error can't find the container with id 34eaea0251f4b39ae8ffc572a9f8fa8ba27c9f6300de9a294233f19613401e67 Jul 06 21:13:44.253759 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.251251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hkzlp"] Jul 06 21:13:44.280184 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:44.280159 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd1e08f_be14_47b4_a559_4e8ff098c94e.slice/crio-6239802973b9d4cb03724d2042b58faf14f4c06a194c9cbf287f0b8666d5f9e0 WatchSource:0}: Error finding container 6239802973b9d4cb03724d2042b58faf14f4c06a194c9cbf287f0b8666d5f9e0: Status 404 returned error can't find the container with id 6239802973b9d4cb03724d2042b58faf14f4c06a194c9cbf287f0b8666d5f9e0 Jul 06 21:13:44.417846 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.417787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:44.417846 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.417818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:44.417846 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:44.417843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.417913 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.417940 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.417959 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.417980 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:46.417961379 +0000 UTC m=+39.137728405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : configmap "kube-rbac-proxy" not found Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.417998 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:46.4179876 +0000 UTC m=+39.137754630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : secret "insights-runtime-extractor-tls" not found Jul 06 21:13:44.418010 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:44.418009 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls podName:f70a946f-97d2-4dea-bb54-056f2777aa6e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:46.418003976 +0000 UTC m=+39.137771002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls") pod "dns-default-l6q28" (UID: "f70a946f-97d2-4dea-bb54-056f2777aa6e") : secret "dns-default-metrics-tls" not found Jul 06 21:13:45.002021 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:45.001984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hkzlp" event={"ID":"dbd1e08f-be14-47b4-a559-4e8ff098c94e","Type":"ContainerStarted","Data":"6239802973b9d4cb03724d2042b58faf14f4c06a194c9cbf287f0b8666d5f9e0"} Jul 06 21:13:45.005558 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:45.005528 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="e777d9fece3d2080c573c0a85daa5b632ee475b3bd1fb14f2cc509d052f813d3" exitCode=0 Jul 06 21:13:45.005703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:45.005611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"e777d9fece3d2080c573c0a85daa5b632ee475b3bd1fb14f2cc509d052f813d3"} Jul 06 21:13:45.007884 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:45.007857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzxlf" event={"ID":"5c343d6c-6ded-404b-886d-4aabb6dcf0a7","Type":"ContainerStarted","Data":"34eaea0251f4b39ae8ffc572a9f8fa8ba27c9f6300de9a294233f19613401e67"} Jul 06 21:13:46.014232 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:46.014194 2581 generic.go:356] "Generic (PLEG): container finished" podID="e02e9f18-e04e-44f5-9802-705a4f0a6c4a" containerID="b912c37c387e1df3e41680c2ed166f60711ba861ebbc5636f6c21a1f23e2285e" exitCode=0 Jul 06 21:13:46.014867 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:46.014272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerDied","Data":"b912c37c387e1df3e41680c2ed166f60711ba861ebbc5636f6c21a1f23e2285e"} Jul 06 21:13:46.437872 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:46.437832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:46.438032 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:46.437881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:46.438032 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:46.437918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:46.438032 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.437990 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:13:46.438200 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.438043 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:13:46.438200 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.438069 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:50.438046805 +0000 UTC m=+43.157813840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : configmap "kube-rbac-proxy" not found Jul 06 21:13:46.438200 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.437989 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:46.438200 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.438093 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:50.438077036 +0000 UTC m=+43.157844078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : secret "insights-runtime-extractor-tls" not found Jul 06 21:13:46.438200 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:46.438164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls podName:f70a946f-97d2-4dea-bb54-056f2777aa6e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:50.438150048 +0000 UTC m=+43.157917074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls") pod "dns-default-l6q28" (UID: "f70a946f-97d2-4dea-bb54-056f2777aa6e") : secret "dns-default-metrics-tls" not found Jul 06 21:13:48.020590 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.020549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hkzlp" event={"ID":"dbd1e08f-be14-47b4-a559-4e8ff098c94e","Type":"ContainerStarted","Data":"9146896cb7f4709e62ed3c69dbbb2d8ef1c086b8a3d8a573ed067e21c6a2f363"} Jul 06 21:13:48.024044 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.024020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c264f" event={"ID":"e02e9f18-e04e-44f5-9802-705a4f0a6c4a","Type":"ContainerStarted","Data":"25235c80c67ad461291d26a2676806aa6a65f8e28b85222913a34066073fd77f"} Jul 06 21:13:48.025508 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.025481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzxlf" event={"ID":"5c343d6c-6ded-404b-886d-4aabb6dcf0a7","Type":"ContainerStarted","Data":"11aeea078d78c4ca9d3e06e35709de579b376ca23cf3fa7aeb629290776a214f"} Jul 06 21:13:48.039746 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.039693 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-hkzlp" podStartSLOduration=2.301266572 podStartE2EDuration="5.039678871s" totalImagesPullingTime="2.738412299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:48.038955825 +0000 UTC m=+40.758722891" watchObservedRunningTime="2026-07-06 21:13:48.039678871 +0000 UTC m=+40.759445918" Jul 06 21:13:48.086173 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.086132 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c264f" podStartSLOduration=11.166066843 podStartE2EDuration="40.086114962s" totalImagesPullingTime="28.920048119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:48.069222962 +0000 UTC m=+40.788990009" watchObservedRunningTime="2026-07-06 21:13:48.086114962 +0000 UTC m=+40.805882011" Jul 06 21:13:48.086703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:48.086668 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zzxlf" podStartSLOduration=3.217727498 podStartE2EDuration="6.086658328s" totalImagesPullingTime="2.86893083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:13:48.085833569 +0000 UTC m=+40.805600616" watchObservedRunningTime="2026-07-06 21:13:48.086658328 +0000 UTC m=+40.806425397" Jul 06 21:13:50.467852 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:50.467818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:50.467852 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:50.467854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:50.468348 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:50.467878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:50.468348 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:50.467968 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:13:50.468348 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:50.467970 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:13:50.468348 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:50.468026 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls podName:f03e4bc0-a048-46d9-bfe8-112993b9bc79 nodeName:}" failed. No retries permitted until 2026-07-06 21:13:58.468014104 +0000 UTC m=+51.187781130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hwvqm" (UID: "f03e4bc0-a048-46d9-bfe8-112993b9bc79") : secret "insights-runtime-extractor-tls" not found Jul 06 21:13:50.468348 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:13:50.468046 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls podName:f70a946f-97d2-4dea-bb54-056f2777aa6e nodeName:}" failed. No retries permitted until 2026-07-06 21:13:58.468032625 +0000 UTC m=+51.187799650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls") pod "dns-default-l6q28" (UID: "f70a946f-97d2-4dea-bb54-056f2777aa6e") : secret "dns-default-metrics-tls" not found Jul 06 21:13:50.468611 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:50.468504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f03e4bc0-a048-46d9-bfe8-112993b9bc79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:58.529853 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.529820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:58.530447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.529862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:58.533256 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.533230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f03e4bc0-a048-46d9-bfe8-112993b9bc79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwvqm\" (UID: \"f03e4bc0-a048-46d9-bfe8-112993b9bc79\") " pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:58.533358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.533259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70a946f-97d2-4dea-bb54-056f2777aa6e-metrics-tls\") pod \"dns-default-l6q28\" (UID: \"f70a946f-97d2-4dea-bb54-056f2777aa6e\") " pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:58.581010 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.580986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6q28" Jul 06 21:13:58.587633 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.587612 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hwvqm" Jul 06 21:13:58.735644 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.735618 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6q28"] Jul 06 21:13:58.739441 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:58.739396 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70a946f_97d2_4dea_bb54_056f2777aa6e.slice/crio-86c9b0633c83931ea5caaf997185a3103f6a1abad729efa28ef014111dd7ddf3 WatchSource:0}: Error finding container 86c9b0633c83931ea5caaf997185a3103f6a1abad729efa28ef014111dd7ddf3: Status 404 returned error can't find the container with id 86c9b0633c83931ea5caaf997185a3103f6a1abad729efa28ef014111dd7ddf3 Jul 06 21:13:58.754740 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:58.754711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hwvqm"] Jul 06 21:13:58.757226 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:13:58.757202 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03e4bc0_a048_46d9_bfe8_112993b9bc79.slice/crio-91871fb11e170b4d97a3fdb8358047391359effcab723916dd1f9e32ccb79538 WatchSource:0}: Error finding container 91871fb11e170b4d97a3fdb8358047391359effcab723916dd1f9e32ccb79538: Status 404 returned error can't find the container with id 91871fb11e170b4d97a3fdb8358047391359effcab723916dd1f9e32ccb79538 Jul 06 21:13:59.054976 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:59.054940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwvqm" event={"ID":"f03e4bc0-a048-46d9-bfe8-112993b9bc79","Type":"ContainerStarted","Data":"91871fb11e170b4d97a3fdb8358047391359effcab723916dd1f9e32ccb79538"} Jul 06 21:13:59.056230 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:13:59.056195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6q28" event={"ID":"f70a946f-97d2-4dea-bb54-056f2777aa6e","Type":"ContainerStarted","Data":"86c9b0633c83931ea5caaf997185a3103f6a1abad729efa28ef014111dd7ddf3"} Jul 06 21:14:04.072458 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.072402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwvqm" event={"ID":"f03e4bc0-a048-46d9-bfe8-112993b9bc79","Type":"ContainerStarted","Data":"a111eb1a56c61b2a2e1fa606ba5b10f120798a757a98d8523ef61cc09a1a2c9f"} Jul 06 21:14:04.072854 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.072480 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwvqm" event={"ID":"f03e4bc0-a048-46d9-bfe8-112993b9bc79","Type":"ContainerStarted","Data":"038c230247e8f19c21f79b125fc1eb7da320ed64f9d60d47c1763d92e6091786"} Jul 06 21:14:04.074141 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.074118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6q28" event={"ID":"f70a946f-97d2-4dea-bb54-056f2777aa6e","Type":"ContainerStarted","Data":"a56af9b19e3ad0b22ba42b65c4e0a93d47301a59507138df1f7d0a1a00005038"} Jul 06 21:14:04.074241 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.074160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6q28" event={"ID":"f70a946f-97d2-4dea-bb54-056f2777aa6e","Type":"ContainerStarted","Data":"7c5c066f2c37e30275e79b037808f2c5b089802d77445520fe76e8811c8dd785"} Jul 06 21:14:04.074376 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.074357 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l6q28" Jul 06 21:14:04.091608 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:04.091571 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l6q28" podStartSLOduration=17.676769302 podStartE2EDuration="22.091558815s" totalImagesPullingTime="4.414789513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:04.090587406 +0000 UTC m=+56.810354454" watchObservedRunningTime="2026-07-06 21:14:04.091558815 +0000 UTC m=+56.811325862" Jul 06 21:14:06.988651 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:06.988629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntgf2" Jul 06 21:14:07.086101 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:07.086073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwvqm" event={"ID":"f03e4bc0-a048-46d9-bfe8-112993b9bc79","Type":"ContainerStarted","Data":"4f07800d07091152f20b41ee76e3bbfc01e6aa791e59a8dc2adb2aab39f26042"} Jul 06 21:14:07.105275 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:07.105233 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hwvqm" podStartSLOduration=17.751474335 podStartE2EDuration="25.105219298s" totalImagesPullingTime="7.353744963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:07.104654874 +0000 UTC m=+59.824421923" watchObservedRunningTime="2026-07-06 21:14:07.105219298 +0000 UTC m=+59.824986345" Jul 06 21:14:08.499469 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.499437 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6plzx"] Jul 06 21:14:08.529191 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.529166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.535241 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.535217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bb2rk\"" Jul 06 21:14:08.536186 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.536167 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 21:14:08.536542 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.536528 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 21:14:08.545128 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.545105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6plzx"] Jul 06 21:14:08.583776 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.583748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:08.603559 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.603538 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-g7f5k"] Jul 06 21:14:08.603677 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.603661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.604564 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.603991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.604693 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.604617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.608247 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.608230 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 21:14:08.608395 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.608379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d8hrj\"" Jul 06 21:14:08.608578 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.608559 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 21:14:08.608694 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.608676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 21:14:08.609395 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.609380 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 21:14:08.609496 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.609384 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 21:14:08.609496 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.609441 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 21:14:08.614623 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.614605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:08.616651 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.616637 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 21:14:08.617362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.617343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hgwbs\"" Jul 06 21:14:08.622004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.621982 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:08.629186 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.629168 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-g7f5k"] Jul 06 21:14:08.682000 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.681977 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-669b4785ff-vq8wv"] Jul 06 21:14:08.705086 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705183 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.705183 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705183 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkplh\" (UniqueName: \"kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705337 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.705337 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4cs\" (UniqueName: \"kubernetes.io/projected/ce15cd3a-6421-451d-821c-054c8d0c3f62-kube-api-access-kg4cs\") pod \"downloads-685bfb5f64-g7f5k\" (UID: \"ce15cd3a-6421-451d-821c-054c8d0c3f62\") " pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:08.705337 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705337 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705533 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.705781 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.705764 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.707221 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.707207 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.707553 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.707534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5c74ab3-b6f3-4756-b66f-ba164cf9b85d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6plzx\" (UID: \"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.712735 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.712717 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 21:14:08.714171 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.714155 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 21:14:08.714461 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.714446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 21:14:08.714517 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.714446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dgf9v\"" Jul 06 21:14:08.728188 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.728166 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 21:14:08.734290 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.734269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669b4785ff-vq8wv"] Jul 06 21:14:08.806379 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqjh\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-kube-api-access-mmqjh\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806509 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.806509 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkplh\" (UniqueName: \"kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.806509 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94e617f-8725-4e28-afea-b75dcea8660b-ca-trust-extracted\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806648 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4cs\" (UniqueName: \"kubernetes.io/projected/ce15cd3a-6421-451d-821c-054c8d0c3f62-kube-api-access-kg4cs\") pod \"downloads-685bfb5f64-g7f5k\" (UID: \"ce15cd3a-6421-451d-821c-054c8d0c3f62\") " pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:08.806648 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-trusted-ca\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806648 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-registry-tls\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-image-registry-private-configuration\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-registry-certificates\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-bound-sa-token\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.806850 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.807142 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-installation-pull-secrets\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.807142 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.806887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.807381 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.807361 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.807573 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.807550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.807670 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.807578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.808881 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.808864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.809260 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.809239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.821854 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.821835 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkplh\" (UniqueName: \"kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh\") pod \"console-79866c8786-kzfwd\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.823530 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.823506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4cs\" (UniqueName: \"kubernetes.io/projected/ce15cd3a-6421-451d-821c-054c8d0c3f62-kube-api-access-kg4cs\") pod \"downloads-685bfb5f64-g7f5k\" (UID: \"ce15cd3a-6421-451d-821c-054c8d0c3f62\") " pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:08.837314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.837298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" Jul 06 21:14:08.907858 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.907824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-installation-pull-secrets\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908012 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.907893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqjh\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-kube-api-access-mmqjh\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908012 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.907940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94e617f-8725-4e28-afea-b75dcea8660b-ca-trust-extracted\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908012 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.907982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-trusted-ca\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908159 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.908054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-registry-tls\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908159 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.908088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-image-registry-private-configuration\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908159 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.908116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-registry-certificates\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908159 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.908141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-bound-sa-token\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.908682 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.908627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94e617f-8725-4e28-afea-b75dcea8660b-ca-trust-extracted\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.909757 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.909717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-registry-certificates\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.910528 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.910504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94e617f-8725-4e28-afea-b75dcea8660b-trusted-ca\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.911116 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.911074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-installation-pull-secrets\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.911644 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.911620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-registry-tls\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.911846 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.911804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94e617f-8725-4e28-afea-b75dcea8660b-image-registry-private-configuration\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.914798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.914776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:08.923389 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.923364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:08.926255 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.926232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-bound-sa-token\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.931262 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.931209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqjh\" (UniqueName: \"kubernetes.io/projected/f94e617f-8725-4e28-afea-b75dcea8660b-kube-api-access-mmqjh\") pod \"image-registry-669b4785ff-vq8wv\" (UID: \"f94e617f-8725-4e28-afea-b75dcea8660b\") " pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:08.987671 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:08.987598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6plzx"] Jul 06 21:14:09.019683 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.019653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:09.073678 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.073632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:09.076795 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:09.076767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5475dc_1844_43ad_bd68_02476e1e6d31.slice/crio-980361a38921787b801f77ac09ce25fffe1ea39d1740714b183c114cc2fb47d3 WatchSource:0}: Error finding container 980361a38921787b801f77ac09ce25fffe1ea39d1740714b183c114cc2fb47d3: Status 404 returned error can't find the container with id 980361a38921787b801f77ac09ce25fffe1ea39d1740714b183c114cc2fb47d3 Jul 06 21:14:09.095904 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.095871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" event={"ID":"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d","Type":"ContainerStarted","Data":"d5db0cdb9255d6df5856075e07b625e4b61ac72ae572d7804cfafb1c4ad6fb21"} Jul 06 21:14:09.096025 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.095938 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-g7f5k"] Jul 06 21:14:09.098290 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:09.098264 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce15cd3a_6421_451d_821c_054c8d0c3f62.slice/crio-9cbdb800220e030ebe0ab2d2b806b18582e08f9e889241f7a5c388b8cb1b7379 WatchSource:0}: Error finding container 9cbdb800220e030ebe0ab2d2b806b18582e08f9e889241f7a5c388b8cb1b7379: Status 404 returned error can't find the container with id 9cbdb800220e030ebe0ab2d2b806b18582e08f9e889241f7a5c388b8cb1b7379 Jul 06 21:14:09.098290 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.098268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79866c8786-kzfwd" event={"ID":"ec5475dc-1844-43ad-bd68-02476e1e6d31","Type":"ContainerStarted","Data":"980361a38921787b801f77ac09ce25fffe1ea39d1740714b183c114cc2fb47d3"} Jul 06 21:14:09.189013 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:09.188980 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-669b4785ff-vq8wv"] Jul 06 21:14:09.191782 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:09.191753 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94e617f_8725_4e28_afea_b75dcea8660b.slice/crio-edf370e820e72311ee0b9831ebacfd57948a9c08384e2ca44d1b3d5499ad195b WatchSource:0}: Error finding container edf370e820e72311ee0b9831ebacfd57948a9c08384e2ca44d1b3d5499ad195b: Status 404 returned error can't find the container with id edf370e820e72311ee0b9831ebacfd57948a9c08384e2ca44d1b3d5499ad195b Jul 06 21:14:10.104953 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:10.104913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" event={"ID":"f94e617f-8725-4e28-afea-b75dcea8660b","Type":"ContainerStarted","Data":"c12151ff8b49a8faf47bb65f192deeb91bbb18861f2a74bf51fcfb127cf71824"} Jul 06 21:14:10.105447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:10.104980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" event={"ID":"f94e617f-8725-4e28-afea-b75dcea8660b","Type":"ContainerStarted","Data":"edf370e820e72311ee0b9831ebacfd57948a9c08384e2ca44d1b3d5499ad195b"} Jul 06 21:14:10.105447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:10.105010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:10.106142 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:10.106101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-g7f5k" event={"ID":"ce15cd3a-6421-451d-821c-054c8d0c3f62","Type":"ContainerStarted","Data":"9cbdb800220e030ebe0ab2d2b806b18582e08f9e889241f7a5c388b8cb1b7379"} Jul 06 21:14:10.127087 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:10.127036 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" podStartSLOduration=2.127016723 podStartE2EDuration="2.127016723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:10.126003798 +0000 UTC m=+62.845770846" watchObservedRunningTime="2026-07-06 21:14:10.127016723 +0000 UTC m=+62.846783778" Jul 06 21:14:11.115217 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:11.115173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" event={"ID":"d5c74ab3-b6f3-4756-b66f-ba164cf9b85d","Type":"ContainerStarted","Data":"3f3f4585b7cf9bc8c09b6d4ca9e14f7a78cd1a0de7d1f1b646f969675ad30e9c"} Jul 06 21:14:11.133777 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:11.133653 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6plzx" podStartSLOduration=1.977913477 podStartE2EDuration="3.133636523s" totalImagesPullingTime="1.155723046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:11.132123825 +0000 UTC m=+63.851890873" watchObservedRunningTime="2026-07-06 21:14:11.133636523 +0000 UTC m=+63.853403570" Jul 06 21:14:13.125009 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.124954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79866c8786-kzfwd" event={"ID":"ec5475dc-1844-43ad-bd68-02476e1e6d31","Type":"ContainerStarted","Data":"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7"} Jul 06 21:14:13.142330 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.142282 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79866c8786-kzfwd" podStartSLOduration=1.7720933190000001 podStartE2EDuration="5.142267237s" totalImagesPullingTime="3.370173918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:13.141947634 +0000 UTC m=+65.861714683" watchObservedRunningTime="2026-07-06 21:14:13.142267237 +0000 UTC m=+65.862034286" Jul 06 21:14:13.444959 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.444878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:14:13.447950 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.447921 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:14:13.458004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.457979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f752983e-067d-41f7-8349-11d0e9387c12-original-pull-secret\") pod \"global-pull-secret-syncer-h6rxc\" (UID: \"f752983e-067d-41f7-8349-11d0e9387c12\") " pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:14:13.545246 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.545219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:14:13.548308 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.548285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:14:13.558621 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.558601 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a33a77bd-9220-404c-807b-9667cbeb2ac5-metrics-certs\") pod \"network-metrics-daemon-lwdvx\" (UID: \"a33a77bd-9220-404c-807b-9667cbeb2ac5\") " pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:14:13.646305 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.646269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:14:13.649538 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.649515 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:14:13.659616 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.659593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:14:13.670445 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.670358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgm2\" (UniqueName: \"kubernetes.io/projected/b748545b-ec14-4b8a-b053-78b128c2515e-kube-api-access-mhgm2\") pod \"network-check-target-2qm4x\" (UID: \"b748545b-ec14-4b8a-b053-78b128c2515e\") " pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:14:13.716143 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.716090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2dbc\"" Jul 06 21:14:13.719404 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.719380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6rxc" Jul 06 21:14:13.723628 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.723606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwdvx" Jul 06 21:14:13.727347 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.727317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kz87d\"" Jul 06 21:14:13.735570 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.735551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:14:13.882740 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:13.882707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6rxc"] Jul 06 21:14:13.886685 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:13.886662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf752983e_067d_41f7_8349_11d0e9387c12.slice/crio-d7ef79c28713941779d29a94186b0ff5a574746c321c8e4b5453d944747dfef9 WatchSource:0}: Error finding container d7ef79c28713941779d29a94186b0ff5a574746c321c8e4b5453d944747dfef9: Status 404 returned error can't find the container with id d7ef79c28713941779d29a94186b0ff5a574746c321c8e4b5453d944747dfef9 Jul 06 21:14:14.080161 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.080131 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l6q28" Jul 06 21:14:14.108247 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.108221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwdvx"] Jul 06 21:14:14.114635 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.114273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2qm4x"] Jul 06 21:14:14.115271 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:14.115231 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb748545b_ec14_4b8a_b053_78b128c2515e.slice/crio-0478758f8f9df96b78c4d38115e6512db2cfd66709badd79dc0d7b1f4cef0a35 WatchSource:0}: Error finding container 0478758f8f9df96b78c4d38115e6512db2cfd66709badd79dc0d7b1f4cef0a35: Status 404 returned error can't find the container with id 0478758f8f9df96b78c4d38115e6512db2cfd66709badd79dc0d7b1f4cef0a35 Jul 06 21:14:14.129858 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.129799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2qm4x" event={"ID":"b748545b-ec14-4b8a-b053-78b128c2515e","Type":"ContainerStarted","Data":"0478758f8f9df96b78c4d38115e6512db2cfd66709badd79dc0d7b1f4cef0a35"} Jul 06 21:14:14.131884 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.131855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwdvx" event={"ID":"a33a77bd-9220-404c-807b-9667cbeb2ac5","Type":"ContainerStarted","Data":"7152d2032836bd5905c6e1756a2c104127ae2fef146f8bcc8c42c76b52467dfa"} Jul 06 21:14:14.133725 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.133704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6rxc" event={"ID":"f752983e-067d-41f7-8349-11d0e9387c12","Type":"ContainerStarted","Data":"d7ef79c28713941779d29a94186b0ff5a574746c321c8e4b5453d944747dfef9"} Jul 06 21:14:14.632262 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.631100 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks"] Jul 06 21:14:14.635140 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.634380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.637322 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.637290 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 21:14:14.637449 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.637295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 21:14:14.640072 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.639576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 21:14:14.640072 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.639625 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 21:14:14.640072 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.639629 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 21:14:14.640072 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.639574 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r9n9x\"" Jul 06 21:14:14.648783 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.645611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks"] Jul 06 21:14:14.754331 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.754059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.754331 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.754119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.754331 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.754167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmqz\" (UniqueName: \"kubernetes.io/projected/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-kube-api-access-lrmqz\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.754331 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.754201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.854577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.854645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.854687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.854734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmqz\" (UniqueName: \"kubernetes.io/projected/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-kube-api-access-lrmqz\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:14:14.855125 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 21:14:14.855355 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:14:14.855187 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls podName:41f95c40-120e-4b0c-b6e2-b6644d0a74fb nodeName:}" failed. No retries permitted until 2026-07-06 21:14:15.355165805 +0000 UTC m=+68.074932833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-tgxks" (UID: "41f95c40-120e-4b0c-b6e2-b6644d0a74fb") : secret "prometheus-operator-tls" not found Jul 06 21:14:14.855784 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.855762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.862862 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.862836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:14.865477 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:14.865362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmqz\" (UniqueName: \"kubernetes.io/projected/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-kube-api-access-lrmqz\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:15.359336 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:15.358664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:15.359336 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:14:15.358838 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 21:14:15.359336 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:14:15.358897 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls podName:41f95c40-120e-4b0c-b6e2-b6644d0a74fb nodeName:}" failed. No retries permitted until 2026-07-06 21:14:16.358883171 +0000 UTC m=+69.078650197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-tgxks" (UID: "41f95c40-120e-4b0c-b6e2-b6644d0a74fb") : secret "prometheus-operator-tls" not found Jul 06 21:14:16.145229 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:16.145134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwdvx" event={"ID":"a33a77bd-9220-404c-807b-9667cbeb2ac5","Type":"ContainerStarted","Data":"2316adc001979e0b5fa34161dd2afd3a48255bf88f573f212287311b1a7dbdfd"} Jul 06 21:14:16.366943 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:16.366568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:16.369827 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:16.369775 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41f95c40-120e-4b0c-b6e2-b6644d0a74fb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tgxks\" (UID: \"41f95c40-120e-4b0c-b6e2-b6644d0a74fb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:16.452757 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:16.452513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" Jul 06 21:14:16.626630 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:16.626491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks"] Jul 06 21:14:16.628333 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:16.628302 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f95c40_120e_4b0c_b6e2_b6644d0a74fb.slice/crio-5b682e70ff71c61cd5f271981e794e20ed2a913e5875e37d03bd552c514a15c7 WatchSource:0}: Error finding container 5b682e70ff71c61cd5f271981e794e20ed2a913e5875e37d03bd552c514a15c7: Status 404 returned error can't find the container with id 5b682e70ff71c61cd5f271981e794e20ed2a913e5875e37d03bd552c514a15c7 Jul 06 21:14:17.151846 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:17.151803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwdvx" event={"ID":"a33a77bd-9220-404c-807b-9667cbeb2ac5","Type":"ContainerStarted","Data":"3d7fab86c66bcf667bb795e846027138d4931f1141c39668c8d66f9abb63be83"} Jul 06 21:14:17.153794 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:17.153763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" event={"ID":"41f95c40-120e-4b0c-b6e2-b6644d0a74fb","Type":"ContainerStarted","Data":"5b682e70ff71c61cd5f271981e794e20ed2a913e5875e37d03bd552c514a15c7"} Jul 06 21:14:17.171217 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:17.171169 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lwdvx" podStartSLOduration=67.447699459 podStartE2EDuration="1m9.171149763s" totalImagesPullingTime="1.723450304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:17.169674568 +0000 UTC m=+69.889441616" watchObservedRunningTime="2026-07-06 21:14:17.171149763 +0000 UTC m=+69.890916812" Jul 06 21:14:18.925436 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:18.916178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:18.925436 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:18.916256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:18.925436 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:18.922496 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:19.165957 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:19.165772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:20.167208 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:20.167125 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2qm4x" event={"ID":"b748545b-ec14-4b8a-b053-78b128c2515e","Type":"ContainerStarted","Data":"8ac2c8d05c455e38e4d135fd39aba546932a6fb0584fb6879ffe65205da52655"} Jul 06 21:14:20.167720 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:20.167249 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:14:20.169108 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:20.169086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6rxc" event={"ID":"f752983e-067d-41f7-8349-11d0e9387c12","Type":"ContainerStarted","Data":"2b3ee8183394ec558cd260cd2236929bc694743447e8b1b2f2b2cca1a1fdf2c5"} Jul 06 21:14:20.187330 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:20.186979 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2qm4x" podStartSLOduration=66.492088734 podStartE2EDuration="1m12.186946954s" totalImagesPullingTime="5.69485822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:20.18588499 +0000 UTC m=+72.905652050" watchObservedRunningTime="2026-07-06 21:14:20.186946954 +0000 UTC m=+72.906714005" Jul 06 21:14:20.203306 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:20.203259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h6rxc" podStartSLOduration=66.272058549 podStartE2EDuration="1m12.203240179s" totalImagesPullingTime="5.93118163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:20.20224802 +0000 UTC m=+72.922015070" watchObservedRunningTime="2026-07-06 21:14:20.203240179 +0000 UTC m=+72.923007229" Jul 06 21:14:21.175469 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:21.175406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" event={"ID":"41f95c40-120e-4b0c-b6e2-b6644d0a74fb","Type":"ContainerStarted","Data":"7d7c21d5dd5f1af42042aa1e2c1eb7d1a16c23d159a4d48a0b7e9e27c52409e7"} Jul 06 21:14:21.175868 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:21.175497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" event={"ID":"41f95c40-120e-4b0c-b6e2-b6644d0a74fb","Type":"ContainerStarted","Data":"8b0c2f538bf361fcd02f17ec9f5fa09f84c0955f78ad1e87c31762df5e2330b0"} Jul 06 21:14:21.198874 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:21.198819 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tgxks" podStartSLOduration=3.069203572 podStartE2EDuration="7.198799871s" totalImagesPullingTime="4.129596299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:21.197097134 +0000 UTC m=+73.916864182" watchObservedRunningTime="2026-07-06 21:14:21.198799871 +0000 UTC m=+73.918566918" Jul 06 21:14:23.058979 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.058945 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5kq69"] Jul 06 21:14:23.062006 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.061982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.064923 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.064895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 21:14:23.065023 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.064925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6nbt4\"" Jul 06 21:14:23.065023 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.064895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 21:14:23.065122 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.065066 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 21:14:23.130527 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-sys\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130527 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-root\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-tls\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-metrics-client-ca\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxf9\" (UniqueName: \"kubernetes.io/projected/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-kube-api-access-fbxf9\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-textfile\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130728 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.130951 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.130779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-wtmp\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.231837 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxf9\" (UniqueName: \"kubernetes.io/projected/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-kube-api-access-fbxf9\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-textfile\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-wtmp\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-sys\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-root\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.232001 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.231981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-tls\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.233167 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.232010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-metrics-client-ca\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.233167 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.232624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-metrics-client-ca\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.233362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.233338 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.233835 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.233490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-sys\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.234517 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.234130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-textfile\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.234517 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.234201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-root\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.234851 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.234815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-wtmp\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.240914 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.240704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.244427 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.241156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-node-exporter-tls\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.253442 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.252832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxf9\" (UniqueName: \"kubernetes.io/projected/ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc-kube-api-access-fbxf9\") pod \"node-exporter-5kq69\" (UID: \"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc\") " pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:23.374234 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:23.374166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kq69" Jul 06 21:14:27.324280 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.324241 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69b4c9b8d-xrfk9"] Jul 06 21:14:27.344570 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.344521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69b4c9b8d-xrfk9"] Jul 06 21:14:27.344702 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.344613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.349197 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349176 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 21:14:27.349618 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349389 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 21:14:27.349618 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349479 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fv0mr0fggk209\"" Jul 06 21:14:27.349618 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349479 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 21:14:27.349855 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349630 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 21:14:27.349855 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.349707 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mhwtq\"" Jul 06 21:14:27.366173 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.365860 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:27.464510 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-tls\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464694 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-metrics-server-audit-profiles\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464694 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-client-certs\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464694 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-client-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464694 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a56d0f4-3448-4652-b089-69ec27273881-audit-log\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464912 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngb47\" (UniqueName: \"kubernetes.io/projected/0a56d0f4-3448-4652-b089-69ec27273881-kube-api-access-ngb47\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.464912 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.464751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566119 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-tls\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-metrics-server-audit-profiles\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-client-certs\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-client-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a56d0f4-3448-4652-b089-69ec27273881-audit-log\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngb47\" (UniqueName: \"kubernetes.io/projected/0a56d0f4-3448-4652-b089-69ec27273881-kube-api-access-ngb47\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.566285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.567228 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.566745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0a56d0f4-3448-4652-b089-69ec27273881-audit-log\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.567228 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.567182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.567385 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.567365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0a56d0f4-3448-4652-b089-69ec27273881-metrics-server-audit-profiles\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.569041 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.569013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-client-certs\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.569220 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.569196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-client-ca-bundle\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.569734 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.569716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0a56d0f4-3448-4652-b089-69ec27273881-secret-metrics-server-tls\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.577055 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.577001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngb47\" (UniqueName: \"kubernetes.io/projected/0a56d0f4-3448-4652-b089-69ec27273881-kube-api-access-ngb47\") pod \"metrics-server-69b4c9b8d-xrfk9\" (UID: \"0a56d0f4-3448-4652-b089-69ec27273881\") " pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.657248 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.657216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:27.814430 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.814381 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm"] Jul 06 21:14:27.849068 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.848999 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm"] Jul 06 21:14:27.849203 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.849098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:27.852891 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.852873 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 21:14:27.853058 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.853017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lv2mv\"" Jul 06 21:14:27.969711 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.969674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc812b-52a4-4a8d-8f03-4256054e31ed-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:27.969892 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:27.969740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnbm\" (UniqueName: \"kubernetes.io/projected/97dc812b-52a4-4a8d-8f03-4256054e31ed-kube-api-access-2xnbm\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.070665 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.070630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc812b-52a4-4a8d-8f03-4256054e31ed-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.070829 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.070677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnbm\" (UniqueName: \"kubernetes.io/projected/97dc812b-52a4-4a8d-8f03-4256054e31ed-kube-api-access-2xnbm\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.073513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.073489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97dc812b-52a4-4a8d-8f03-4256054e31ed-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.080527 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.080501 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnbm\" (UniqueName: \"kubernetes.io/projected/97dc812b-52a4-4a8d-8f03-4256054e31ed-kube-api-access-2xnbm\") pod \"monitoring-plugin-d5dcff7cf-r6bxm\" (UID: \"97dc812b-52a4-4a8d-8f03-4256054e31ed\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.159595 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.159515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:28.333868 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:28.333831 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded25ff1b_6a86_4b2c_b4fe_b4f06aac6adc.slice/crio-a3de25b75df4ac023c0d433e163fc90cbba9e25c25fd083184f036e8da9529b2 WatchSource:0}: Error finding container a3de25b75df4ac023c0d433e163fc90cbba9e25c25fd083184f036e8da9529b2: Status 404 returned error can't find the container with id a3de25b75df4ac023c0d433e163fc90cbba9e25c25fd083184f036e8da9529b2 Jul 06 21:14:28.460639 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.460617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69b4c9b8d-xrfk9"] Jul 06 21:14:28.462951 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:28.462928 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a56d0f4_3448_4652_b089_69ec27273881.slice/crio-0ac7422b818814997d6c9a490a938f4a0dff0b79ce74ee26c990fa30bc8a1849 WatchSource:0}: Error finding container 0ac7422b818814997d6c9a490a938f4a0dff0b79ce74ee26c990fa30bc8a1849: Status 404 returned error can't find the container with id 0ac7422b818814997d6c9a490a938f4a0dff0b79ce74ee26c990fa30bc8a1849 Jul 06 21:14:28.478141 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:28.478119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm"] Jul 06 21:14:28.481159 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:28.481132 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97dc812b_52a4_4a8d_8f03_4256054e31ed.slice/crio-25950702c8fffaa68538a797299e1187a1ada7039c008ce8f92dd98c6ad5496a WatchSource:0}: Error finding container 25950702c8fffaa68538a797299e1187a1ada7039c008ce8f92dd98c6ad5496a: Status 404 returned error can't find the container with id 25950702c8fffaa68538a797299e1187a1ada7039c008ce8f92dd98c6ad5496a Jul 06 21:14:29.222258 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.222150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" event={"ID":"97dc812b-52a4-4a8d-8f03-4256054e31ed","Type":"ContainerStarted","Data":"25950702c8fffaa68538a797299e1187a1ada7039c008ce8f92dd98c6ad5496a"} Jul 06 21:14:29.225982 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.225910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kq69" event={"ID":"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc","Type":"ContainerStarted","Data":"a3de25b75df4ac023c0d433e163fc90cbba9e25c25fd083184f036e8da9529b2"} Jul 06 21:14:29.237311 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.236888 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-g7f5k" event={"ID":"ce15cd3a-6421-451d-821c-054c8d0c3f62","Type":"ContainerStarted","Data":"d81fdf640b2ab9ac18ffcd06304e0824b74afc7aedc7eb2594bb1bbd78e7d11e"} Jul 06 21:14:29.240149 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.238226 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:29.242137 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.242071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" event={"ID":"0a56d0f4-3448-4652-b089-69ec27273881","Type":"ContainerStarted","Data":"0ac7422b818814997d6c9a490a938f4a0dff0b79ce74ee26c990fa30bc8a1849"} Jul 06 21:14:29.253575 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.253527 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-g7f5k" Jul 06 21:14:29.259857 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.259717 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-g7f5k" podStartSLOduration=1.647103672 podStartE2EDuration="21.259698461s" totalImagesPullingTime="19.612594789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:29.257023074 +0000 UTC m=+81.976790125" watchObservedRunningTime="2026-07-06 21:14:29.259698461 +0000 UTC m=+81.979465510" Jul 06 21:14:29.376776 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.375353 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:14:29.407513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.406490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:14:29.407513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.406669 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.415034 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.414824 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 21:14:29.417408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.416609 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zdh7z\"" Jul 06 21:14:29.417408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.416855 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 21:14:29.417408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.417040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 21:14:29.417408 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.417263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 21:14:29.417820 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.415773 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 21:14:29.418717 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.418701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.419518 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.419739 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.419935 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.420092 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.420212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 21:14:29.420584 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.420525 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5cens4opj94d\"" Jul 06 21:14:29.421129 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.421108 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 21:14:29.422669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.422612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 21:14:29.429063 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.428786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 21:14:29.484127 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484127 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484373 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78725\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-kube-api-access-78725\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.484696 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.484387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486513 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486640 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486640 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486640 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486792 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486792 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486792 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.486792 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.486775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588215 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78725\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-kube-api-access-78725\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588434 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.588915 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.588786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.592362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.590225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.592362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.590405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.592362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.590982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.592362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.591082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.592362 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.591662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.604036 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.604007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.614864 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.608666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.615353 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.615325 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.618253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.618578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.619304 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.619369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.619788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.620256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.620646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.620970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.621111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.621472 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.621561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.624543 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.622342 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78725\" (UniqueName: \"kubernetes.io/projected/4f54b3a5-cadc-42cc-9ae9-788841e56f1d-kube-api-access-78725\") pod \"prometheus-k8s-0\" (UID: \"4f54b3a5-cadc-42cc-9ae9-788841e56f1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.731645 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.731611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:29.988533 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:29.978987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:14:30.122378 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:14:30.122329 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f54b3a5_cadc_42cc_9ae9_788841e56f1d.slice/crio-e88c4b921e779c747b90dc6c8049947e9a260d489c9445d5e4e93c1f6a139f92 WatchSource:0}: Error finding container e88c4b921e779c747b90dc6c8049947e9a260d489c9445d5e4e93c1f6a139f92: Status 404 returned error can't find the container with id e88c4b921e779c747b90dc6c8049947e9a260d489c9445d5e4e93c1f6a139f92 Jul 06 21:14:30.250582 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:30.250535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"e88c4b921e779c747b90dc6c8049947e9a260d489c9445d5e4e93c1f6a139f92"} Jul 06 21:14:31.121447 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:31.121315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-669b4785ff-vq8wv" Jul 06 21:14:32.261341 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.261299 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" event={"ID":"97dc812b-52a4-4a8d-8f03-4256054e31ed","Type":"ContainerStarted","Data":"38ca40db8aaf515d4b0d26ff826d6fe1b55869d14ecccf3f3ae9cb514b8e0525"} Jul 06 21:14:32.262464 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.262438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:32.265834 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.265806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kq69" event={"ID":"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc","Type":"ContainerStarted","Data":"ad08613d1e94a97fff641b62aaca5e3ee44b757644f33cea127d95da6f67c577"} Jul 06 21:14:32.269558 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.269485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" event={"ID":"0a56d0f4-3448-4652-b089-69ec27273881","Type":"ContainerStarted","Data":"f5ee52d0092383aabc5923155deb6ce110c48dd18ae01b7560b5b9174776c9a1"} Jul 06 21:14:32.270185 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.270132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" Jul 06 21:14:32.302593 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.302549 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r6bxm" podStartSLOduration=1.7641049309999999 podStartE2EDuration="5.302533748s" totalImagesPullingTime="3.538428817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:32.281520977 +0000 UTC m=+85.001288026" watchObservedRunningTime="2026-07-06 21:14:32.302533748 +0000 UTC m=+85.022300796" Jul 06 21:14:32.303394 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:32.303359 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" podStartSLOduration=1.7467502270000002 podStartE2EDuration="5.303350451s" totalImagesPullingTime="3.556600224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:32.301669813 +0000 UTC m=+85.021436861" watchObservedRunningTime="2026-07-06 21:14:32.303350451 +0000 UTC m=+85.023117501" Jul 06 21:14:33.276706 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:33.276665 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc" containerID="ad08613d1e94a97fff641b62aaca5e3ee44b757644f33cea127d95da6f67c577" exitCode=0 Jul 06 21:14:33.277180 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:33.276764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kq69" event={"ID":"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc","Type":"ContainerDied","Data":"ad08613d1e94a97fff641b62aaca5e3ee44b757644f33cea127d95da6f67c577"} Jul 06 21:14:33.279450 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:33.279402 2581 generic.go:356] "Generic (PLEG): container finished" podID="4f54b3a5-cadc-42cc-9ae9-788841e56f1d" containerID="7c3a78833575aa589a53314fe2e72754fd5e0c5e57f5f6ce82df55971981aa49" exitCode=0 Jul 06 21:14:33.279706 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:33.279673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerDied","Data":"7c3a78833575aa589a53314fe2e72754fd5e0c5e57f5f6ce82df55971981aa49"} Jul 06 21:14:34.293733 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:34.293701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kq69" event={"ID":"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc","Type":"ContainerStarted","Data":"58e705b955c3f9df5e9bfcbfbd22ce1fa26673f51935826c947281c147fff847"} Jul 06 21:14:34.294474 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:34.294405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kq69" event={"ID":"ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc","Type":"ContainerStarted","Data":"7d632a4c477f5dac259beecb9ea15147b0ccdde18aa24d93e5cf7d273874cee1"} Jul 06 21:14:34.318379 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:34.318328 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5kq69" podStartSLOduration=7.521966241 podStartE2EDuration="11.318313378s" totalImagesPullingTime="3.683755012s" totalInitContainerRuntime="112.592125ms" isStatefulPod=true podCreationTimestamp="2026-07-06 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:34.316767569 +0000 UTC m=+87.036534618" watchObservedRunningTime="2026-07-06 21:14:34.318313378 +0000 UTC m=+87.038080425" Jul 06 21:14:38.313886 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:38.313846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"aa5216f7cb09aa9a0124d161c27715cc8b3866a73b72b0ed695880fc4d1dafaf"} Jul 06 21:14:38.314317 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:38.313967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"934fb9be0bfdf18ce46cd39c98cdf25a65f77123adce7a0eff15cd90b8b82e24"} Jul 06 21:14:41.328712 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:41.328681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"2ebb329348099cec4f39ec3093afc1b411b3862a73319e83178538b362f54b6f"} Jul 06 21:14:41.329138 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:41.328746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"8c508ccf2828bd4810f057a171d367957f54cf83343497ea55d9bce43efd83fa"} Jul 06 21:14:41.329138 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:41.328774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"16874a50ac1bcb47f8efbc30c451611c0ce5e65df91d18848e8e790686a0692c"} Jul 06 21:14:41.329138 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:41.328799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f54b3a5-cadc-42cc-9ae9-788841e56f1d","Type":"ContainerStarted","Data":"a57af632245da96e9920bb7c0d848083168f81e3ce1e59441fd5ec31f2f79f2c"} Jul 06 21:14:41.360058 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:41.360002 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.402152075 podStartE2EDuration="12.359978957s" totalImagesPullingTime="8.928470205s" totalInitContainerRuntime="29.356677ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:14:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:14:41.357866058 +0000 UTC m=+94.077633106" watchObservedRunningTime="2026-07-06 21:14:41.359978957 +0000 UTC m=+94.079746007" Jul 06 21:14:44.731955 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:44.731922 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:14:47.657703 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:47.657664 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:47.658134 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:47.657729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:14:51.178237 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:51.178208 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2qm4x" Jul 06 21:14:52.392036 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.391978 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79866c8786-kzfwd" podUID="ec5475dc-1844-43ad-bd68-02476e1e6d31" containerName="console" containerID="cri-o://b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7" gracePeriod=15 Jul 06 21:14:52.680902 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.680869 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:52.789430 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789388 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.789579 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789463 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkplh\" (UniqueName: \"kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.789653 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789603 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.789709 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.789709 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789688 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.789803 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.789719 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config\") pod \"ec5475dc-1844-43ad-bd68-02476e1e6d31\" (UID: \"ec5475dc-1844-43ad-bd68-02476e1e6d31\") " Jul 06 21:14:52.790057 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.790022 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:14:52.790057 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.790038 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:14:52.790382 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.790091 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config" (OuterVolumeSpecName: "console-config") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:14:52.791929 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.791907 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:14:52.792157 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.792143 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:14:52.792221 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.792199 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh" (OuterVolumeSpecName: "kube-api-access-wkplh") pod "ec5475dc-1844-43ad-bd68-02476e1e6d31" (UID: "ec5475dc-1844-43ad-bd68-02476e1e6d31"). InnerVolumeSpecName "kube-api-access-wkplh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:14:52.890680 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890658 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-service-ca\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:52.890680 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890677 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-config\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:52.890808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890685 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-serving-cert\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:52.890808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890694 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkplh\" (UniqueName: \"kubernetes.io/projected/ec5475dc-1844-43ad-bd68-02476e1e6d31-kube-api-access-wkplh\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:52.890808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890705 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec5475dc-1844-43ad-bd68-02476e1e6d31-console-oauth-config\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:52.890808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:52.890713 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec5475dc-1844-43ad-bd68-02476e1e6d31-oauth-serving-cert\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:14:53.375753 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.375717 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec5475dc-1844-43ad-bd68-02476e1e6d31" containerID="b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7" exitCode=0 Jul 06 21:14:53.375753 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.375756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79866c8786-kzfwd" event={"ID":"ec5475dc-1844-43ad-bd68-02476e1e6d31","Type":"ContainerDied","Data":"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7"} Jul 06 21:14:53.375976 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.375765 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79866c8786-kzfwd" Jul 06 21:14:53.375976 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.375790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79866c8786-kzfwd" event={"ID":"ec5475dc-1844-43ad-bd68-02476e1e6d31","Type":"ContainerDied","Data":"980361a38921787b801f77ac09ce25fffe1ea39d1740714b183c114cc2fb47d3"} Jul 06 21:14:53.375976 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.375812 2581 scope.go:117] "RemoveContainer" containerID="b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7" Jul 06 21:14:53.384259 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.384241 2581 scope.go:117] "RemoveContainer" containerID="b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7" Jul 06 21:14:53.384550 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:14:53.384528 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7\": container with ID starting with b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7 not found: ID does not exist" containerID="b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7" Jul 06 21:14:53.384612 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.384558 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7"} err="failed to get container status \"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7\": rpc error: code = NotFound desc = could not find container \"b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7\": container with ID starting with b693e55d05f94f6e8a3b79e5f129c298ab9f7f480a480d773839460d9ce768e7 not found: ID does not exist" Jul 06 21:14:53.396710 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.396681 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:53.400586 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.400567 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79866c8786-kzfwd"] Jul 06 21:14:53.805083 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:14:53.805048 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec5475dc-1844-43ad-bd68-02476e1e6d31" path="/var/lib/kubelet/pods/ec5475dc-1844-43ad-bd68-02476e1e6d31/volumes" Jul 06 21:15:07.663027 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:15:07.662996 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:15:07.666813 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:15:07.666791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69b4c9b8d-xrfk9" Jul 06 21:15:29.731958 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:15:29.731926 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:15:29.751242 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:15:29.751217 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:15:30.516388 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:15:30.516363 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:18:07.630572 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:18:07.630540 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 21:19:43.086751 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.086716 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-zllfg"] Jul 06 21:19:43.087318 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.086996 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5475dc-1844-43ad-bd68-02476e1e6d31" containerName="console" Jul 06 21:19:43.087318 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.087008 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5475dc-1844-43ad-bd68-02476e1e6d31" containerName="console" Jul 06 21:19:43.087318 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.087063 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5475dc-1844-43ad-bd68-02476e1e6d31" containerName="console" Jul 06 21:19:43.094041 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.094013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.096817 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.096791 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-ntszs\"" Jul 06 21:19:43.096955 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.096817 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 06 21:19:43.098033 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.098014 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 21:19:43.098143 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.098059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 21:19:43.104089 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.104071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-zllfg"] Jul 06 21:19:43.187581 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.187546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnc4\" (UniqueName: \"kubernetes.io/projected/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-kube-api-access-stnc4\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.187781 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.187674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-tls-certs\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.288339 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.288306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-tls-certs\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.288339 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.288355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stnc4\" (UniqueName: \"kubernetes.io/projected/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-kube-api-access-stnc4\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.290955 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.290935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-tls-certs\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.297181 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.297153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnc4\" (UniqueName: \"kubernetes.io/projected/cc85e55b-b842-4a58-a6da-33dbc49e0f2e-kube-api-access-stnc4\") pod \"model-serving-api-fd65d7d6-zllfg\" (UID: \"cc85e55b-b842-4a58-a6da-33dbc49e0f2e\") " pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.406294 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.406198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:43.535648 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.535615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-zllfg"] Jul 06 21:19:43.537651 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:19:43.537628 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc85e55b_b842_4a58_a6da_33dbc49e0f2e.slice/crio-6796e76149eeff31cd13a1d51d9c41a4ce63dc6de3115e94ff76cf7c79cceabc WatchSource:0}: Error finding container 6796e76149eeff31cd13a1d51d9c41a4ce63dc6de3115e94ff76cf7c79cceabc: Status 404 returned error can't find the container with id 6796e76149eeff31cd13a1d51d9c41a4ce63dc6de3115e94ff76cf7c79cceabc Jul 06 21:19:43.539487 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:43.539473 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:19:44.379789 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:44.379753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-zllfg" event={"ID":"cc85e55b-b842-4a58-a6da-33dbc49e0f2e","Type":"ContainerStarted","Data":"6796e76149eeff31cd13a1d51d9c41a4ce63dc6de3115e94ff76cf7c79cceabc"} Jul 06 21:19:46.388292 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:46.388262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-zllfg" event={"ID":"cc85e55b-b842-4a58-a6da-33dbc49e0f2e","Type":"ContainerStarted","Data":"ab2e1b18b18d8043abc904dcd4e362da200fe8ed8157b7395db9a4d9eb7a90ab"} Jul 06 21:19:46.388730 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:46.388325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:46.408029 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:46.407975 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-zllfg" podStartSLOduration=1.070638648 podStartE2EDuration="3.407960329s" totalImagesPullingTime="2.337321681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:19:46.406782509 +0000 UTC m=+399.126549559" watchObservedRunningTime="2026-07-06 21:19:46.407960329 +0000 UTC m=+399.127727377" Jul 06 21:19:57.395791 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:57.395757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-zllfg" Jul 06 21:19:59.451429 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.451396 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-55ptl"] Jul 06 21:19:59.453328 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.453312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-55ptl" Jul 06 21:19:59.456017 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.455997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 21:19:59.456150 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.456132 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6pfr9\"" Jul 06 21:19:59.469570 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.469550 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-55ptl"] Jul 06 21:19:59.512552 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.512516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f88qh\" (UniqueName: \"kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.512727 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.512591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.613158 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.613111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.613158 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.613171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f88qh\" (UniqueName: \"kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.613536 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.613519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.622841 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.622823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f88qh\" (UniqueName: \"kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh\") pod \"s3-init-55ptl\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " pod="kserve/s3-init-55ptl" Jul 06 21:19:59.784090 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.784000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-55ptl" Jul 06 21:19:59.915770 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:19:59.915739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-55ptl"] Jul 06 21:19:59.919266 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:19:59.919233 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6075b51_db55_441f_a0a1_221acaed7d67.slice/crio-fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59 WatchSource:0}: Error finding container fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59: Status 404 returned error can't find the container with id fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59 Jul 06 21:20:00.438578 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:00.438547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerStarted","Data":"fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59"} Jul 06 21:20:04.454449 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:04.454398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerStarted","Data":"0aaa5f8663734baf8a37ab368162ba8fc25d595ddc4da5faaa28b1b11cd1c626"} Jul 06 21:20:06.463766 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:06.463730 2581 generic.go:356] "Generic (PLEG): container finished" podID="a6075b51-db55-441f-a0a1-221acaed7d67" containerID="0aaa5f8663734baf8a37ab368162ba8fc25d595ddc4da5faaa28b1b11cd1c626" exitCode=0 Jul 06 21:20:06.464249 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:06.463811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerDied","Data":"0aaa5f8663734baf8a37ab368162ba8fc25d595ddc4da5faaa28b1b11cd1c626"} Jul 06 21:20:11.640539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:11.640516 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 21:20:12.491388 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:12.491355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerStarted","Data":"fccc46c1be4aed0b257a0610712afa50d1400337b50c3f30e7b965b33675fbca"} Jul 06 21:20:12.508742 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:20:12.508694 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-55ptl" podStartSLOduration=2.687185375 podStartE2EDuration="13.508677472s" totalImagesPullingTime="9.157654336s" totalInitContainerRuntime="1.663837761s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:19:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:20:12.507231168 +0000 UTC m=+425.226998217" watchObservedRunningTime="2026-07-06 21:20:12.508677472 +0000 UTC m=+425.228444519" Jul 06 21:21:17.720525 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:17.720490 2581 generic.go:356] "Generic (PLEG): container finished" podID="a6075b51-db55-441f-a0a1-221acaed7d67" containerID="fccc46c1be4aed0b257a0610712afa50d1400337b50c3f30e7b965b33675fbca" exitCode=0 Jul 06 21:21:17.720922 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:17.720564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerDied","Data":"fccc46c1be4aed0b257a0610712afa50d1400337b50c3f30e7b965b33675fbca"} Jul 06 21:21:18.847483 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:18.847404 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-55ptl" Jul 06 21:21:18.971861 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:18.971814 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache\") pod \"a6075b51-db55-441f-a0a1-221acaed7d67\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " Jul 06 21:21:18.972074 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:18.971942 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f88qh\" (UniqueName: \"kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh\") pod \"a6075b51-db55-441f-a0a1-221acaed7d67\" (UID: \"a6075b51-db55-441f-a0a1-221acaed7d67\") " Jul 06 21:21:18.974266 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:18.974194 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh" (OuterVolumeSpecName: "kube-api-access-f88qh") pod "a6075b51-db55-441f-a0a1-221acaed7d67" (UID: "a6075b51-db55-441f-a0a1-221acaed7d67"). InnerVolumeSpecName "kube-api-access-f88qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:21:18.990481 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:18.990451 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6075b51-db55-441f-a0a1-221acaed7d67" (UID: "a6075b51-db55-441f-a0a1-221acaed7d67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:21:19.072576 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:19.072539 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f88qh\" (UniqueName: \"kubernetes.io/projected/a6075b51-db55-441f-a0a1-221acaed7d67-kube-api-access-f88qh\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:21:19.072576 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:19.072568 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6075b51-db55-441f-a0a1-221acaed7d67-model-cache\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:21:19.728539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:19.728500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-55ptl" event={"ID":"a6075b51-db55-441f-a0a1-221acaed7d67","Type":"ContainerDied","Data":"fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59"} Jul 06 21:21:19.728539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:19.728517 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-55ptl" Jul 06 21:21:19.728539 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:19.728540 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf683135da31ab0dbbf4aa1ac0d6af3fc668d404fd497322494b71306e68a59" Jul 06 21:21:31.874616 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874582 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:21:31.874987 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874851 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6075b51-db55-441f-a0a1-221acaed7d67" containerName="s3-init" Jul 06 21:21:31.874987 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874861 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6075b51-db55-441f-a0a1-221acaed7d67" containerName="s3-init" Jul 06 21:21:31.874987 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874871 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6075b51-db55-441f-a0a1-221acaed7d67" containerName="download-hf-model" Jul 06 21:21:31.874987 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6075b51-db55-441f-a0a1-221acaed7d67" containerName="download-hf-model" Jul 06 21:21:31.874987 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.874927 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6075b51-db55-441f-a0a1-221acaed7d67" containerName="s3-init" Jul 06 21:21:31.877962 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.877941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:31.880798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880774 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 06 21:21:31.880949 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 06 21:21:31.880949 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880820 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2qpmz\"" Jul 06 21:21:31.880949 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880808 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 06 21:21:31.880949 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 06 21:21:31.880949 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.880868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 06 21:21:31.881968 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.881953 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 06 21:21:31.889133 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.889113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:21:31.978290 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.978255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:31.978523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.978301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:31.978523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.978339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2khm\" (UniqueName: \"kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:31.978523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.978374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:31.978523 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:31.978436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079011 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.078970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079210 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079210 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2khm\" (UniqueName: \"kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079210 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079210 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079537 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.079770 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079747 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.080003 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.079973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.080981 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.080964 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:21:32.082285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.082264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.084511 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.084496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.087038 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.087015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 06 21:21:32.087176 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.087019 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 06 21:21:32.089669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.089651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2khm\" (UniqueName: \"kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm\") pod \"isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.094982 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.094963 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:21:32.180057 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.179965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.180057 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.180014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.180234 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.180094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.180234 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.180128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.180234 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.180158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpnl9\" (UniqueName: \"kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.187937 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.187916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.281393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.281472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.281510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpnl9\" (UniqueName: \"kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.281557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.281592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.282001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.282600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.283808 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.283493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.285630 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.285607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.295881 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.295852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpnl9\" (UniqueName: \"kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6nztq\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.302399 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.302375 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:21:32.307444 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.307405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.310396 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.310376 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 06 21:21:32.310782 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.310763 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 06 21:21:32.319622 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.319570 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:21:32.339368 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.339342 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:21:32.342518 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:21:32.342487 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78559ff5_3194_4521_a0d3_f2c5040afd2f.slice/crio-ce12a48d39a51d549201d29e79154422e367e65f8a807ffce01f50ab2ebf2f3e WatchSource:0}: Error finding container ce12a48d39a51d549201d29e79154422e367e65f8a807ffce01f50ab2ebf2f3e: Status 404 returned error can't find the container with id ce12a48d39a51d549201d29e79154422e367e65f8a807ffce01f50ab2ebf2f3e Jul 06 21:21:32.382491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.382468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.382592 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.382566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.382631 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.382618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snjcj\" (UniqueName: \"kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.382695 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.382681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.382729 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.382712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.407255 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.407232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:21:32.483738 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.483706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.483967 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.483755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.483967 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.483929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.484110 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.484005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.484110 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.484043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snjcj\" (UniqueName: \"kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.484530 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.484508 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.484652 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.484549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.485056 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.485030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.486723 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.486703 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.493372 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.493348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snjcj\" (UniqueName: \"kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj\") pod \"isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.552978 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.552809 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:21:32.555949 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:21:32.555920 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e869b6_f28e_44c7_a6d7_d7473da102e9.slice/crio-f14059f8fe402408da747d7067dabee8430dece2f28000dea8d9f57646cae922 WatchSource:0}: Error finding container f14059f8fe402408da747d7067dabee8430dece2f28000dea8d9f57646cae922: Status 404 returned error can't find the container with id f14059f8fe402408da747d7067dabee8430dece2f28000dea8d9f57646cae922 Jul 06 21:21:32.619570 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.619491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:21:32.773837 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.773537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:21:32.775633 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.775602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerStarted","Data":"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed"} Jul 06 21:21:32.775820 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.775801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerStarted","Data":"f14059f8fe402408da747d7067dabee8430dece2f28000dea8d9f57646cae922"} Jul 06 21:21:32.776477 ip-10-0-142-144 kubenswrapper[2581]: W0706 21:21:32.776452 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175815ab_fb60_4265_b8da_5b99a17e59d4.slice/crio-1806e7c6e4bf84b3ad682c31fa9d4b50b465a3d53016878748e76b0e3ad905b5 WatchSource:0}: Error finding container 1806e7c6e4bf84b3ad682c31fa9d4b50b465a3d53016878748e76b0e3ad905b5: Status 404 returned error can't find the container with id 1806e7c6e4bf84b3ad682c31fa9d4b50b465a3d53016878748e76b0e3ad905b5 Jul 06 21:21:32.777485 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.777462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerStarted","Data":"780a5bba90f9a2587c44b47b524b9f795b66e40e27ae625a91e1b9d326d328f6"} Jul 06 21:21:32.777561 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:32.777519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerStarted","Data":"ce12a48d39a51d549201d29e79154422e367e65f8a807ffce01f50ab2ebf2f3e"} Jul 06 21:21:33.782154 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:33.782116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerStarted","Data":"ed4673e2190c1ede74f8ae955c417f81694a2cf9e3b03a93ad33ba0ce1ba30d3"} Jul 06 21:21:33.782605 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:33.782208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerStarted","Data":"1806e7c6e4bf84b3ad682c31fa9d4b50b465a3d53016878748e76b0e3ad905b5"} Jul 06 21:21:36.795484 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.795436 2581 generic.go:356] "Generic (PLEG): container finished" podID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerID="ed4673e2190c1ede74f8ae955c417f81694a2cf9e3b03a93ad33ba0ce1ba30d3" exitCode=0 Jul 06 21:21:36.795484 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.795455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerDied","Data":"ed4673e2190c1ede74f8ae955c417f81694a2cf9e3b03a93ad33ba0ce1ba30d3"} Jul 06 21:21:36.797155 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.797085 2581 generic.go:356] "Generic (PLEG): container finished" podID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerID="f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed" exitCode=0 Jul 06 21:21:36.797208 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.797151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerDied","Data":"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed"} Jul 06 21:21:36.798849 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.798793 2581 generic.go:356] "Generic (PLEG): container finished" podID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerID="780a5bba90f9a2587c44b47b524b9f795b66e40e27ae625a91e1b9d326d328f6" exitCode=0 Jul 06 21:21:36.798849 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:21:36.798815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerDied","Data":"780a5bba90f9a2587c44b47b524b9f795b66e40e27ae625a91e1b9d326d328f6"} Jul 06 21:22:04.989929 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:04.989789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerStarted","Data":"8e2261b7f6280d5b76abcf9f9c42c8f8790453a3f6ce9fc46e1944d6878a9a25"} Jul 06 21:22:04.993666 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:04.993574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerStarted","Data":"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82"} Jul 06 21:22:08.007978 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.007943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerStarted","Data":"5a44636b45778ca3623e544fbfbbbde0cd9a8fedcba85bee5822de064ec7445b"} Jul 06 21:22:08.008449 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.008133 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:22:08.008449 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.008314 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:22:08.009766 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.009729 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:08.010187 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.010165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerStarted","Data":"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054"} Jul 06 21:22:08.010285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.010224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:22:08.010285 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.010256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:22:08.011389 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.011355 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:08.012265 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.012245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerStarted","Data":"67795a6bf0790a09821324b9b0b79007c2e0a26251807e0c871e0941f10b88de"} Jul 06 21:22:08.012368 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.012286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerStarted","Data":"e46516464240188c6862ee11d0cbbf4b8547b2c15e092eef3b8e8166569147b9"} Jul 06 21:22:08.012535 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.012519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:22:08.012609 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.012562 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:22:08.013405 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.013384 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:08.028365 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.028319 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podStartSLOduration=2.295218787 podStartE2EDuration="36.028304568s" totalImagesPullingTime="30.074044845s" totalInitContainerRuntime="3.659040936s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:08.026520517 +0000 UTC m=+540.746287567" watchObservedRunningTime="2026-07-06 21:22:08.028304568 +0000 UTC m=+540.748071615" Jul 06 21:22:08.044540 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.044488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podStartSLOduration=3.138728384 podStartE2EDuration="37.044474092s" totalImagesPullingTime="30.150664823s" totalInitContainerRuntime="3.755080885s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:08.043097043 +0000 UTC m=+540.762864088" watchObservedRunningTime="2026-07-06 21:22:08.044474092 +0000 UTC m=+540.764241140" Jul 06 21:22:08.063224 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:08.063183 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podStartSLOduration=2.148599489 podStartE2EDuration="36.063169839s" totalImagesPullingTime="30.071715901s" totalInitContainerRuntime="3.842854449s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:08.062238575 +0000 UTC m=+540.782005623" watchObservedRunningTime="2026-07-06 21:22:08.063169839 +0000 UTC m=+540.782936887" Jul 06 21:22:09.015990 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:09.015946 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:09.016459 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:09.016028 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:09.016459 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:09.016030 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:14.020871 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.020843 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:22:14.021443 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.021399 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:22:14.021515 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.021391 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:14.021818 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.021801 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:22:14.021920 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.021896 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:14.022177 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:14.022158 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:24.021299 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:24.021255 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:24.021890 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:24.021867 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:24.023086 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:24.023062 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:34.022290 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:34.022244 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:34.022697 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:34.022251 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:34.022697 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:34.022251 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:44.021297 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:44.021258 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:44.022500 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:44.022474 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:22:44.022595 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:44.022479 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:54.021630 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:54.021592 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:22:54.022058 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:54.021890 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:22:54.023078 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:22:54.023057 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:23:04.021954 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:04.021908 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:23:04.022363 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:04.021918 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:23:04.022363 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:04.022212 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:23:14.022030 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:14.021989 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:23:14.022445 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:14.021986 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:23:14.022563 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:14.022548 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:23:22.801526 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:22.801497 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:23:24.022464 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:23:24.022431 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:24:01.820336 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.820305 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:24:01.820923 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.820617 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kube-rbac-proxy" containerID="cri-o://8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054" gracePeriod=30 Jul 06 21:24:01.820923 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.820608 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" containerID="cri-o://3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82" gracePeriod=30 Jul 06 21:24:01.867262 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.867220 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:24:01.867532 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.867503 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" containerID="cri-o://8e2261b7f6280d5b76abcf9f9c42c8f8790453a3f6ce9fc46e1944d6878a9a25" gracePeriod=30 Jul 06 21:24:01.867609 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.867514 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kube-rbac-proxy" containerID="cri-o://5a44636b45778ca3623e544fbfbbbde0cd9a8fedcba85bee5822de064ec7445b" gracePeriod=30 Jul 06 21:24:01.926171 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.926140 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:24:01.926489 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.926449 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" containerID="cri-o://e46516464240188c6862ee11d0cbbf4b8547b2c15e092eef3b8e8166569147b9" gracePeriod=30 Jul 06 21:24:01.926628 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:01.926479 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kube-rbac-proxy" containerID="cri-o://67795a6bf0790a09821324b9b0b79007c2e0a26251807e0c871e0941f10b88de" gracePeriod=30 Jul 06 21:24:02.465705 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.465674 2581 generic.go:356] "Generic (PLEG): container finished" podID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerID="5a44636b45778ca3623e544fbfbbbde0cd9a8fedcba85bee5822de064ec7445b" exitCode=2 Jul 06 21:24:02.465883 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.465751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerDied","Data":"5a44636b45778ca3623e544fbfbbbde0cd9a8fedcba85bee5822de064ec7445b"} Jul 06 21:24:02.467776 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.467751 2581 generic.go:356] "Generic (PLEG): container finished" podID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerID="8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054" exitCode=2 Jul 06 21:24:02.467906 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.467834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerDied","Data":"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054"} Jul 06 21:24:02.469715 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.469696 2581 generic.go:356] "Generic (PLEG): container finished" podID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerID="67795a6bf0790a09821324b9b0b79007c2e0a26251807e0c871e0941f10b88de" exitCode=2 Jul 06 21:24:02.469798 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.469723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerDied","Data":"67795a6bf0790a09821324b9b0b79007c2e0a26251807e0c871e0941f10b88de"} Jul 06 21:24:02.801305 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:02.801270 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused" Jul 06 21:24:04.016678 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:04.016644 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.22:8643/healthz\": dial tcp 10.134.0.22:8643: connect: connection refused" Jul 06 21:24:04.016678 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:04.016646 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.21:8643/healthz\": dial tcp 10.134.0.21:8643: connect: connection refused" Jul 06 21:24:04.017073 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:04.016647 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.20:8643/healthz\": dial tcp 10.134.0.20:8643: connect: connection refused" Jul 06 21:24:04.022261 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:04.022238 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.21:8080: connect: connection refused" Jul 06 21:24:04.022314 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:04.022240 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 06 21:24:05.366587 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.366564 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:24:05.398135 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398114 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls\") pod \"47e869b6-f28e-44c7-a6d7-d7473da102e9\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " Jul 06 21:24:05.398249 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398147 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location\") pod \"47e869b6-f28e-44c7-a6d7-d7473da102e9\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " Jul 06 21:24:05.398249 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398166 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpnl9\" (UniqueName: \"kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9\") pod \"47e869b6-f28e-44c7-a6d7-d7473da102e9\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " Jul 06 21:24:05.398249 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398200 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert\") pod \"47e869b6-f28e-44c7-a6d7-d7473da102e9\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " Jul 06 21:24:05.398249 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398225 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config\") pod \"47e869b6-f28e-44c7-a6d7-d7473da102e9\" (UID: \"47e869b6-f28e-44c7-a6d7-d7473da102e9\") " Jul 06 21:24:05.398532 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398499 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "47e869b6-f28e-44c7-a6d7-d7473da102e9" (UID: "47e869b6-f28e-44c7-a6d7-d7473da102e9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:24:05.398638 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398605 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "47e869b6-f28e-44c7-a6d7-d7473da102e9" (UID: "47e869b6-f28e-44c7-a6d7-d7473da102e9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:05.398734 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.398709 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "47e869b6-f28e-44c7-a6d7-d7473da102e9" (UID: "47e869b6-f28e-44c7-a6d7-d7473da102e9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:05.400558 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.400528 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "47e869b6-f28e-44c7-a6d7-d7473da102e9" (UID: "47e869b6-f28e-44c7-a6d7-d7473da102e9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:24:05.400642 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.400578 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9" (OuterVolumeSpecName: "kube-api-access-mpnl9") pod "47e869b6-f28e-44c7-a6d7-d7473da102e9" (UID: "47e869b6-f28e-44c7-a6d7-d7473da102e9"). InnerVolumeSpecName "kube-api-access-mpnl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:24:05.484514 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.484431 2581 generic.go:356] "Generic (PLEG): container finished" podID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerID="3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82" exitCode=0 Jul 06 21:24:05.484514 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.484474 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" Jul 06 21:24:05.484669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.484516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerDied","Data":"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82"} Jul 06 21:24:05.484669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.484572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq" event={"ID":"47e869b6-f28e-44c7-a6d7-d7473da102e9","Type":"ContainerDied","Data":"f14059f8fe402408da747d7067dabee8430dece2f28000dea8d9f57646cae922"} Jul 06 21:24:05.484669 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.484599 2581 scope.go:117] "RemoveContainer" containerID="8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054" Jul 06 21:24:05.495305 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.495273 2581 scope.go:117] "RemoveContainer" containerID="3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82" Jul 06 21:24:05.498991 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.498969 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47e869b6-f28e-44c7-a6d7-d7473da102e9-proxy-tls\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:05.499053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.499000 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47e869b6-f28e-44c7-a6d7-d7473da102e9-kserve-provision-location\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:05.499053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.499016 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpnl9\" (UniqueName: \"kubernetes.io/projected/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-api-access-mpnl9\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:05.499053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.499030 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-cabundle-cert\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:05.499053 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.499043 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47e869b6-f28e-44c7-a6d7-d7473da102e9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:05.503108 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.503092 2581 scope.go:117] "RemoveContainer" containerID="f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed" Jul 06 21:24:05.513690 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.513658 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:24:05.514018 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.513997 2581 scope.go:117] "RemoveContainer" containerID="8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054" Jul 06 21:24:05.514290 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:24:05.514273 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054\": container with ID starting with 8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054 not found: ID does not exist" containerID="8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054" Jul 06 21:24:05.514351 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.514299 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054"} err="failed to get container status \"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054\": rpc error: code = NotFound desc = could not find container \"8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054\": container with ID starting with 8b5822b2d050fe44b80488f98ed3c1e41bf0a0db1eb9a3d717f600c67a347054 not found: ID does not exist" Jul 06 21:24:05.514351 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.514317 2581 scope.go:117] "RemoveContainer" containerID="3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82" Jul 06 21:24:05.514609 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:24:05.514588 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82\": container with ID starting with 3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82 not found: ID does not exist" containerID="3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82" Jul 06 21:24:05.514699 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.514613 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82"} err="failed to get container status \"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82\": rpc error: code = NotFound desc = could not find container \"3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82\": container with ID starting with 3f5e44a2a10598165217fe75292d19a5f9b87d5eb458e87edcced08767b75c82 not found: ID does not exist" Jul 06 21:24:05.514699 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.514628 2581 scope.go:117] "RemoveContainer" containerID="f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed" Jul 06 21:24:05.514925 ip-10-0-142-144 kubenswrapper[2581]: E0706 21:24:05.514908 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed\": container with ID starting with f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed not found: ID does not exist" containerID="f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed" Jul 06 21:24:05.514984 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.514928 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed"} err="failed to get container status \"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed\": rpc error: code = NotFound desc = could not find container \"f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed\": container with ID starting with f5ef3affa74d0bfc15bc466134dddc8fc19cd2609553b22fb98c4834ab82feed not found: ID does not exist" Jul 06 21:24:05.515268 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.515248 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6nztq"] Jul 06 21:24:05.805261 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:05.805228 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" path="/var/lib/kubelet/pods/47e869b6-f28e-44c7-a6d7-d7473da102e9/volumes" Jul 06 21:24:06.491627 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.491440 2581 generic.go:356] "Generic (PLEG): container finished" podID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerID="e46516464240188c6862ee11d0cbbf4b8547b2c15e092eef3b8e8166569147b9" exitCode=0 Jul 06 21:24:06.491627 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.491523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerDied","Data":"e46516464240188c6862ee11d0cbbf4b8547b2c15e092eef3b8e8166569147b9"} Jul 06 21:24:06.493783 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.493763 2581 generic.go:356] "Generic (PLEG): container finished" podID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerID="8e2261b7f6280d5b76abcf9f9c42c8f8790453a3f6ce9fc46e1944d6878a9a25" exitCode=0 Jul 06 21:24:06.493904 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.493819 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerDied","Data":"8e2261b7f6280d5b76abcf9f9c42c8f8790453a3f6ce9fc46e1944d6878a9a25"} Jul 06 21:24:06.506934 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.506914 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:24:06.569956 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.569931 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:24:06.607898 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.607868 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert\") pod \"78559ff5-3194-4521-a0d3-f2c5040afd2f\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " Jul 06 21:24:06.607898 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.607908 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location\") pod \"175815ab-fb60-4265-b8da-5b99a17e59d4\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " Jul 06 21:24:06.608144 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.607930 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert\") pod \"175815ab-fb60-4265-b8da-5b99a17e59d4\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " Jul 06 21:24:06.608144 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls\") pod \"175815ab-fb60-4265-b8da-5b99a17e59d4\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " Jul 06 21:24:06.608144 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608099 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls\") pod \"78559ff5-3194-4521-a0d3-f2c5040afd2f\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " Jul 06 21:24:06.608144 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608125 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snjcj\" (UniqueName: \"kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj\") pod \"175815ab-fb60-4265-b8da-5b99a17e59d4\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2khm\" (UniqueName: \"kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm\") pod \"78559ff5-3194-4521-a0d3-f2c5040afd2f\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608199 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location\") pod \"78559ff5-3194-4521-a0d3-f2c5040afd2f\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608214 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "175815ab-fb60-4265-b8da-5b99a17e59d4" (UID: "175815ab-fb60-4265-b8da-5b99a17e59d4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608225 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "78559ff5-3194-4521-a0d3-f2c5040afd2f" (UID: "78559ff5-3194-4521-a0d3-f2c5040afd2f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608234 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config\") pod \"78559ff5-3194-4521-a0d3-f2c5040afd2f\" (UID: \"78559ff5-3194-4521-a0d3-f2c5040afd2f\") " Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608250 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "175815ab-fb60-4265-b8da-5b99a17e59d4" (UID: "175815ab-fb60-4265-b8da-5b99a17e59d4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:06.608358 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608290 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config\") pod \"175815ab-fb60-4265-b8da-5b99a17e59d4\" (UID: \"175815ab-fb60-4265-b8da-5b99a17e59d4\") " Jul 06 21:24:06.608748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608650 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "78559ff5-3194-4521-a0d3-f2c5040afd2f" (UID: "78559ff5-3194-4521-a0d3-f2c5040afd2f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:06.608748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608670 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-cabundle-cert\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.608748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608690 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/175815ab-fb60-4265-b8da-5b99a17e59d4-kserve-provision-location\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.608748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608704 2581 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-cabundle-cert\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.608748 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608724 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "78559ff5-3194-4521-a0d3-f2c5040afd2f" (UID: "78559ff5-3194-4521-a0d3-f2c5040afd2f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:24:06.609004 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.608818 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "175815ab-fb60-4265-b8da-5b99a17e59d4" (UID: "175815ab-fb60-4265-b8da-5b99a17e59d4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:24:06.610546 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.610508 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj" (OuterVolumeSpecName: "kube-api-access-snjcj") pod "175815ab-fb60-4265-b8da-5b99a17e59d4" (UID: "175815ab-fb60-4265-b8da-5b99a17e59d4"). InnerVolumeSpecName "kube-api-access-snjcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:24:06.610546 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.610539 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "78559ff5-3194-4521-a0d3-f2c5040afd2f" (UID: "78559ff5-3194-4521-a0d3-f2c5040afd2f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:24:06.610920 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.610903 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "175815ab-fb60-4265-b8da-5b99a17e59d4" (UID: "175815ab-fb60-4265-b8da-5b99a17e59d4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:24:06.610976 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.610922 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm" (OuterVolumeSpecName: "kube-api-access-j2khm") pod "78559ff5-3194-4521-a0d3-f2c5040afd2f" (UID: "78559ff5-3194-4521-a0d3-f2c5040afd2f"). InnerVolumeSpecName "kube-api-access-j2khm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:24:06.709031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.708989 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/175815ab-fb60-4265-b8da-5b99a17e59d4-proxy-tls\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709024 2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78559ff5-3194-4521-a0d3-f2c5040afd2f-proxy-tls\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709033 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snjcj\" (UniqueName: \"kubernetes.io/projected/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-api-access-snjcj\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709041 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2khm\" (UniqueName: \"kubernetes.io/projected/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-api-access-j2khm\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709031 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709051 2581 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78559ff5-3194-4521-a0d3-f2c5040afd2f-kserve-provision-location\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709311 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709060 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/78559ff5-3194-4521-a0d3-f2c5040afd2f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:06.709311 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:06.709068 2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/175815ab-fb60-4265-b8da-5b99a17e59d4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 21:24:07.500286 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.500250 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" Jul 06 21:24:07.500716 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.500253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5" event={"ID":"78559ff5-3194-4521-a0d3-f2c5040afd2f","Type":"ContainerDied","Data":"ce12a48d39a51d549201d29e79154422e367e65f8a807ffce01f50ab2ebf2f3e"} Jul 06 21:24:07.500716 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.500390 2581 scope.go:117] "RemoveContainer" containerID="67795a6bf0790a09821324b9b0b79007c2e0a26251807e0c871e0941f10b88de" Jul 06 21:24:07.502168 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.502152 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" Jul 06 21:24:07.502282 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.502150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6" event={"ID":"175815ab-fb60-4265-b8da-5b99a17e59d4","Type":"ContainerDied","Data":"1806e7c6e4bf84b3ad682c31fa9d4b50b465a3d53016878748e76b0e3ad905b5"} Jul 06 21:24:07.508847 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.508828 2581 scope.go:117] "RemoveContainer" containerID="e46516464240188c6862ee11d0cbbf4b8547b2c15e092eef3b8e8166569147b9" Jul 06 21:24:07.516298 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.516282 2581 scope.go:117] "RemoveContainer" containerID="780a5bba90f9a2587c44b47b524b9f795b66e40e27ae625a91e1b9d326d328f6" Jul 06 21:24:07.523254 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.523237 2581 scope.go:117] "RemoveContainer" containerID="5a44636b45778ca3623e544fbfbbbde0cd9a8fedcba85bee5822de064ec7445b" Jul 06 21:24:07.524491 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.524475 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:24:07.528267 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.528249 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-766fdfb6bb-b4zd5"] Jul 06 21:24:07.530684 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.530660 2581 scope.go:117] "RemoveContainer" containerID="8e2261b7f6280d5b76abcf9f9c42c8f8790453a3f6ce9fc46e1944d6878a9a25" Jul 06 21:24:07.537388 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.537363 2581 scope.go:117] "RemoveContainer" containerID="ed4673e2190c1ede74f8ae955c417f81694a2cf9e3b03a93ad33ba0ce1ba30d3" Jul 06 21:24:07.539266 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.539244 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:24:07.541201 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.541184 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-767d6d7f5d-qmcj6"] Jul 06 21:24:07.806103 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.806074 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" path="/var/lib/kubelet/pods/175815ab-fb60-4265-b8da-5b99a17e59d4/volumes" Jul 06 21:24:07.806579 ip-10-0-142-144 kubenswrapper[2581]: I0706 21:24:07.806560 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" path="/var/lib/kubelet/pods/78559ff5-3194-4521-a0d3-f2c5040afd2f/volumes" Jul 06 22:01:23.108479 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108382 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j6xpw/must-gather-kmlph"] Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108720 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108733 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108742 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108747 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108756 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108762 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108768 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108774 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="storage-initializer" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108782 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108787 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108793 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108800 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108807 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108812 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108827 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108833 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108837 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108881 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108888 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108895 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78559ff5-3194-4521-a0d3-f2c5040afd2f" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108901 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e869b6-f28e-44c7-a6d7-d7473da102e9" containerName="kube-rbac-proxy" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108907 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kserve-container" Jul 06 22:01:23.111531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.108912 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="175815ab-fb60-4265-b8da-5b99a17e59d4" containerName="kube-rbac-proxy" Jul 06 22:01:23.112668 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.112654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.115369 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.115344 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j6xpw\"/\"openshift-service-ca.crt\"" Jul 06 22:01:23.115566 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.115435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j6xpw\"/\"default-dockercfg-2ccm8\"" Jul 06 22:01:23.115566 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.115434 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j6xpw\"/\"kube-root-ca.crt\"" Jul 06 22:01:23.121024 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.121006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j6xpw/must-gather-kmlph"] Jul 06 22:01:23.213499 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.213468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.213499 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.213500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zlr\" (UniqueName: \"kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.314286 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.314255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.314286 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.314289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zlr\" (UniqueName: \"kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.314646 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.314628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.322624 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.322603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zlr\" (UniqueName: \"kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr\") pod \"must-gather-kmlph\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.432539 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.432467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:23.555651 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.555536 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j6xpw/must-gather-kmlph"] Jul 06 22:01:23.557684 ip-10-0-142-144 kubenswrapper[2581]: W0706 22:01:23.557658 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dfb9443_759f_404a_9a23_1ea23e790a55.slice/crio-03ef71ab4d3399d8bcc6600f694eaef44b3ccb084b782c9787b3ced4b2599dc7 WatchSource:0}: Error finding container 03ef71ab4d3399d8bcc6600f694eaef44b3ccb084b782c9787b3ced4b2599dc7: Status 404 returned error can't find the container with id 03ef71ab4d3399d8bcc6600f694eaef44b3ccb084b782c9787b3ced4b2599dc7 Jul 06 22:01:23.559317 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:23.559301 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:01:24.369465 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:24.369431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j6xpw/must-gather-kmlph" event={"ID":"4dfb9443-759f-404a-9a23-1ea23e790a55","Type":"ContainerStarted","Data":"03ef71ab4d3399d8bcc6600f694eaef44b3ccb084b782c9787b3ced4b2599dc7"} Jul 06 22:01:30.398101 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:30.398011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j6xpw/must-gather-kmlph" event={"ID":"4dfb9443-759f-404a-9a23-1ea23e790a55","Type":"ContainerStarted","Data":"89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0"} Jul 06 22:01:30.398101 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:30.398066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j6xpw/must-gather-kmlph" event={"ID":"4dfb9443-759f-404a-9a23-1ea23e790a55","Type":"ContainerStarted","Data":"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14"} Jul 06 22:01:30.413999 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:30.413952 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j6xpw/must-gather-kmlph" podStartSLOduration=0.89564506 podStartE2EDuration="7.413936677s" totalImagesPullingTime="6.518291617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:01:30.412989313 +0000 UTC m=+2903.132756361" watchObservedRunningTime="2026-07-06 22:01:30.413936677 +0000 UTC m=+2903.133703725" Jul 06 22:01:50.477915 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:50.477879 2581 generic.go:356] "Generic (PLEG): container finished" podID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerID="b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14" exitCode=0 Jul 06 22:01:50.478362 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:50.477922 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j6xpw/must-gather-kmlph" event={"ID":"4dfb9443-759f-404a-9a23-1ea23e790a55","Type":"ContainerDied","Data":"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14"} Jul 06 22:01:50.478362 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:50.478200 2581 scope.go:117] "RemoveContainer" containerID="b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14" Jul 06 22:01:51.285586 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:51.285555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j6xpw_must-gather-kmlph_4dfb9443-759f-404a-9a23-1ea23e790a55/gather/0.log" Jul 06 22:01:54.457581 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:54.457552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h6rxc_f752983e-067d-41f7-8349-11d0e9387c12/global-pull-secret-syncer/0.log" Jul 06 22:01:54.661896 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:54.661865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q8jx7_a21f674c-e464-4034-aef4-1216e70c2a2c/konnectivity-agent/0.log" Jul 06 22:01:54.734583 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:54.734512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-144.ec2.internal_2f554e2b8de4942207b69bb5df078360/haproxy/0.log" Jul 06 22:01:56.730347 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:56.730315 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-j6xpw/must-gather-kmlph"] Jul 06 22:01:56.730899 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:56.730523 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-j6xpw/must-gather-kmlph" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="copy" containerID="cri-o://89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0" gracePeriod=2 Jul 06 22:01:56.734973 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:56.734231 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-j6xpw/must-gather-kmlph"] Jul 06 22:01:56.960280 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:56.960258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j6xpw_must-gather-kmlph_4dfb9443-759f-404a-9a23-1ea23e790a55/copy/0.log" Jul 06 22:01:56.962498 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:56.962477 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:56.965339 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:56.965310 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlph\" is forbidden: User \"system:node:ip-10-0-142-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j6xpw\": no relationship found between node 'ip-10-0-142-144.ec2.internal' and this object" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:57.097230 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.097201 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22zlr\" (UniqueName: \"kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr\") pod \"4dfb9443-759f-404a-9a23-1ea23e790a55\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " Jul 06 22:01:57.097384 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.097260 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output\") pod \"4dfb9443-759f-404a-9a23-1ea23e790a55\" (UID: \"4dfb9443-759f-404a-9a23-1ea23e790a55\") " Jul 06 22:01:57.098760 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.098737 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4dfb9443-759f-404a-9a23-1ea23e790a55" (UID: "4dfb9443-759f-404a-9a23-1ea23e790a55"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:01:57.099469 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.099451 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr" (OuterVolumeSpecName: "kube-api-access-22zlr") pod "4dfb9443-759f-404a-9a23-1ea23e790a55" (UID: "4dfb9443-759f-404a-9a23-1ea23e790a55"). InnerVolumeSpecName "kube-api-access-22zlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:01:57.198022 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.197987 2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4dfb9443-759f-404a-9a23-1ea23e790a55-must-gather-output\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 22:01:57.198022 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.198017 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22zlr\" (UniqueName: \"kubernetes.io/projected/4dfb9443-759f-404a-9a23-1ea23e790a55-kube-api-access-22zlr\") on node \"ip-10-0-142-144.ec2.internal\" DevicePath \"\"" Jul 06 22:01:57.504969 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.504884 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j6xpw_must-gather-kmlph_4dfb9443-759f-404a-9a23-1ea23e790a55/copy/0.log" Jul 06 22:01:57.505257 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.505236 2581 generic.go:356] "Generic (PLEG): container finished" podID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerID="89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0" exitCode=143 Jul 06 22:01:57.505309 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.505279 2581 scope.go:117] "RemoveContainer" containerID="89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0" Jul 06 22:01:57.505309 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.505286 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:57.507772 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:57.507744 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlph\" is forbidden: User \"system:node:ip-10-0-142-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j6xpw\": no relationship found between node 'ip-10-0-142-144.ec2.internal' and this object" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:57.513093 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.513071 2581 scope.go:117] "RemoveContainer" containerID="b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14" Jul 06 22:01:57.515162 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:57.515142 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlph\" is forbidden: User \"system:node:ip-10-0-142-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j6xpw\": no relationship found between node 'ip-10-0-142-144.ec2.internal' and this object" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:57.525046 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.525031 2581 scope.go:117] "RemoveContainer" containerID="89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0" Jul 06 22:01:57.525294 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:57.525274 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0\": container with ID starting with 89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0 not found: ID does not exist" containerID="89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0" Jul 06 22:01:57.525340 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.525304 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0"} err="failed to get container status \"89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0\": rpc error: code = NotFound desc = could not find container \"89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0\": container with ID starting with 89b087f010e2a64e1baa6fc5c590ca1e6e6a05ec807b3936d6dd3296e62d65d0 not found: ID does not exist" Jul 06 22:01:57.525340 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.525320 2581 scope.go:117] "RemoveContainer" containerID="b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14" Jul 06 22:01:57.525566 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:57.525549 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14\": container with ID starting with b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14 not found: ID does not exist" containerID="b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14" Jul 06 22:01:57.525605 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.525572 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14"} err="failed to get container status \"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14\": rpc error: code = NotFound desc = could not find container \"b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14\": container with ID starting with b76426fc257c21667f154b5a1fc5d18f64a784125223cc2b0d63eba287ae3a14 not found: ID does not exist" Jul 06 22:01:57.804625 ip-10-0-142-144 kubenswrapper[2581]: E0706 22:01:57.804584 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlph\" is forbidden: User \"system:node:ip-10-0-142-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j6xpw\": no relationship found between node 'ip-10-0-142-144.ec2.internal' and this object" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" pod="openshift-must-gather-j6xpw/must-gather-kmlph" Jul 06 22:01:57.805293 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:57.805273 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" path="/var/lib/kubelet/pods/4dfb9443-759f-404a-9a23-1ea23e790a55/volumes" Jul 06 22:01:59.518750 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.518723 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69b4c9b8d-xrfk9_0a56d0f4-3448-4652-b089-69ec27273881/metrics-server/0.log" Jul 06 22:01:59.544352 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.544324 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-r6bxm_97dc812b-52a4-4a8d-8f03-4256054e31ed/monitoring-plugin/0.log" Jul 06 22:01:59.577040 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.577018 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kq69_ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc/node-exporter/0.log" Jul 06 22:01:59.598799 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.598777 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kq69_ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc/kube-rbac-proxy/0.log" Jul 06 22:01:59.622655 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.622638 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kq69_ed25ff1b-6a86-4b2c-b4fe-b4f06aac6adc/init-textfile/0.log" Jul 06 22:01:59.899293 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.899211 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/prometheus/0.log" Jul 06 22:01:59.918138 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.918117 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/config-reloader/0.log" Jul 06 22:01:59.941051 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.941025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/thanos-sidecar/0.log" Jul 06 22:01:59.972238 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.972213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/kube-rbac-proxy-web/0.log" Jul 06 22:01:59.994171 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:01:59.994146 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/kube-rbac-proxy/0.log" Jul 06 22:02:00.015540 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:00.015510 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/kube-rbac-proxy-thanos/0.log" Jul 06 22:02:00.046174 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:00.046151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f54b3a5-cadc-42cc-9ae9-788841e56f1d/init-config-reloader/0.log" Jul 06 22:02:00.077862 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:00.077830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tgxks_41f95c40-120e-4b0c-b6e2-b6644d0a74fb/prometheus-operator/0.log" Jul 06 22:02:00.102316 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:00.102290 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tgxks_41f95c40-120e-4b0c-b6e2-b6644d0a74fb/kube-rbac-proxy/0.log" Jul 06 22:02:01.496697 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:01.496610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6plzx_d5c74ab3-b6f3-4756-b66f-ba164cf9b85d/networking-console-plugin/0.log" Jul 06 22:02:02.484826 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.484797 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-g7f5k_ce15cd3a-6421-451d-821c-054c8d0c3f62/download-server/0.log" Jul 06 22:02:02.825684 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825651 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m"] Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825921 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="gather" Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825932 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="gather" Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825943 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="copy" Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825949 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="copy" Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.825998 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="copy" Jul 06 22:02:02.826055 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.826006 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dfb9443-759f-404a-9a23-1ea23e790a55" containerName="gather" Jul 06 22:02:02.830546 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.830523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:02.833556 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.833535 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d2pl7\"/\"kube-root-ca.crt\"" Jul 06 22:02:02.833667 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.833535 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d2pl7\"/\"openshift-service-ca.crt\"" Jul 06 22:02:02.834592 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.834578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d2pl7\"/\"default-dockercfg-hwbkv\"" Jul 06 22:02:02.842241 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.842219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m"] Jul 06 22:02:02.944781 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.944742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-lib-modules\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:02.944781 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.944782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-podres\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:02.945022 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.944805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjr5k\" (UniqueName: \"kubernetes.io/projected/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-kube-api-access-gjr5k\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:02.945022 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.944899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-sys\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:02.945022 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:02.944970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-proc\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046018 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.045979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-proc\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046181 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-lib-modules\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046181 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-proc\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046181 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-podres\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046181 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046157 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-lib-modules\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046181 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjr5k\" (UniqueName: \"kubernetes.io/projected/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-kube-api-access-gjr5k\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046340 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-sys\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046340 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-podres\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.046340 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.046290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-sys\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.056830 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.056806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjr5k\" (UniqueName: \"kubernetes.io/projected/681c59cc-a71b-4ec8-842f-d7dca1a1db5f-kube-api-access-gjr5k\") pod \"perf-node-gather-daemonset-mvl7m\" (UID: \"681c59cc-a71b-4ec8-842f-d7dca1a1db5f\") " pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.139663 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.139585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.267777 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.267749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m"] Jul 06 22:02:03.270117 ip-10-0-142-144 kubenswrapper[2581]: W0706 22:02:03.270082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod681c59cc_a71b_4ec8_842f_d7dca1a1db5f.slice/crio-326a2738e4cf2c37c9f14f4c78d4d860a34ccf4d37d1e0b1e5af04902ca2b1dd WatchSource:0}: Error finding container 326a2738e4cf2c37c9f14f4c78d4d860a34ccf4d37d1e0b1e5af04902ca2b1dd: Status 404 returned error can't find the container with id 326a2738e4cf2c37c9f14f4c78d4d860a34ccf4d37d1e0b1e5af04902ca2b1dd Jul 06 22:02:03.528883 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.528794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" event={"ID":"681c59cc-a71b-4ec8-842f-d7dca1a1db5f","Type":"ContainerStarted","Data":"d91dc781b671b7855777ab346d1821f491e0977d67e19589b7e263caf6e253a6"} Jul 06 22:02:03.528883 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.528843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" event={"ID":"681c59cc-a71b-4ec8-842f-d7dca1a1db5f","Type":"ContainerStarted","Data":"326a2738e4cf2c37c9f14f4c78d4d860a34ccf4d37d1e0b1e5af04902ca2b1dd"} Jul 06 22:02:03.529086 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.528912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:03.546680 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.546633 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" podStartSLOduration=1.5466195520000001 podStartE2EDuration="1.546619552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:02:03.54545673 +0000 UTC m=+2936.265223778" watchObservedRunningTime="2026-07-06 22:02:03.546619552 +0000 UTC m=+2936.266386599" Jul 06 22:02:03.922539 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.922511 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6q28_f70a946f-97d2-4dea-bb54-056f2777aa6e/dns/0.log" Jul 06 22:02:03.942207 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:03.942185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6q28_f70a946f-97d2-4dea-bb54-056f2777aa6e/kube-rbac-proxy/0.log" Jul 06 22:02:04.090877 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:04.090849 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f7lmx_d84793ef-dc6b-422d-a1ea-52f7b2e73264/dns-node-resolver/0.log" Jul 06 22:02:04.576506 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:04.576476 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-669b4785ff-vq8wv_f94e617f-8725-4e28-afea-b75dcea8660b/registry/0.log" Jul 06 22:02:04.602578 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:04.602554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5t2fs_aad30afc-572b-4aac-9c31-3914527929d8/node-ca/0.log" Jul 06 22:02:05.829067 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:05.829034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zzxlf_5c343d6c-6ded-404b-886d-4aabb6dcf0a7/serve-healthcheck-canary/0.log" Jul 06 22:02:06.257236 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:06.257167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwvqm_f03e4bc0-a048-46d9-bfe8-112993b9bc79/kube-rbac-proxy/0.log" Jul 06 22:02:06.275770 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:06.275740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwvqm_f03e4bc0-a048-46d9-bfe8-112993b9bc79/exporter/0.log" Jul 06 22:02:06.294367 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:06.294346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwvqm_f03e4bc0-a048-46d9-bfe8-112993b9bc79/extractor/0.log" Jul 06 22:02:08.393226 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:08.393201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-zllfg_cc85e55b-b842-4a58-a6da-33dbc49e0f2e/server/0.log" Jul 06 22:02:08.615996 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:08.615968 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-55ptl_a6075b51-db55-441f-a0a1-221acaed7d67/s3-init/0.log" Jul 06 22:02:08.631069 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:08.631044 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-55ptl_a6075b51-db55-441f-a0a1-221acaed7d67/download-hf-model/0.log" Jul 06 22:02:09.542387 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:09.542360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d2pl7/perf-node-gather-daemonset-mvl7m" Jul 06 22:02:13.999427 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:13.999336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/kube-multus-additional-cni-plugins/0.log" Jul 06 22:02:14.019584 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.019557 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/egress-router-binary-copy/0.log" Jul 06 22:02:14.042644 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.042624 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/cni-plugins/0.log" Jul 06 22:02:14.064531 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.064504 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/bond-cni-plugin/0.log" Jul 06 22:02:14.084729 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.084708 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/routeoverride-cni/0.log" Jul 06 22:02:14.105275 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.105255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/whereabouts-cni-bincopy/0.log" Jul 06 22:02:14.124260 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.124243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c264f_e02e9f18-e04e-44f5-9802-705a4f0a6c4a/whereabouts-cni/0.log" Jul 06 22:02:14.324564 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.324534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7r88_7eeed2a5-9a29-4eff-9a60-5c16c08b536d/kube-multus/0.log" Jul 06 22:02:14.418404 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.418375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwdvx_a33a77bd-9220-404c-807b-9667cbeb2ac5/network-metrics-daemon/0.log" Jul 06 22:02:14.435260 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:14.435228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwdvx_a33a77bd-9220-404c-807b-9667cbeb2ac5/kube-rbac-proxy/0.log" Jul 06 22:02:15.577154 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.577126 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/ovn-controller/0.log" Jul 06 22:02:15.593614 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.593589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/ovn-acl-logging/0.log" Jul 06 22:02:15.614973 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.614954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/kube-rbac-proxy-node/0.log" Jul 06 22:02:15.633715 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.633699 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 22:02:15.653283 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.653262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/northd/0.log" Jul 06 22:02:15.672605 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.672586 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/nbdb/0.log" Jul 06 22:02:15.693901 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.693881 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/sbdb/0.log" Jul 06 22:02:15.748710 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:15.748691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ntgf2_49addfd0-6f4b-4337-8088-bdf0e067cab7/ovnkube-controller/0.log" Jul 06 22:02:16.733426 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:16.733383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2qm4x_b748545b-ec14-4b8a-b053-78b128c2515e/network-check-target-container/0.log" Jul 06 22:02:17.670175 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:17.670139 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xbsss_d32c1e27-25c5-4cc1-bb21-c0dbcfa0639e/iptables-alerter/0.log" Jul 06 22:02:18.249963 ip-10-0-142-144 kubenswrapper[2581]: I0706 22:02:18.249933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2z8n9_bcbd5dfe-172b-428f-9139-e88ccf639f38/tuned/0.log"