Jul 01 14:39:24.073792 ip-10-0-137-172 systemd[1]: Starting Kubernetes Kubelet... Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.460312 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464590 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464603 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464607 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464612 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464616 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464619 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464622 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.515619 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464626 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464629 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464632 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464635 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464638 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464643 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464646 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464650 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464653 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464656 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464658 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464663 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464666 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464669 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464672 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464675 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464678 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464682 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464687 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464690 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.516531 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464693 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464697 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464700 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464703 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464706 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464709 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464712 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464715 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464718 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464721 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464723 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464726 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464729 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464733 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464735 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464738 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464741 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464743 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464746 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464749 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.517194 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464752 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464754 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464757 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464760 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464762 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464765 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464767 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464770 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464773 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464778 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464783 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464786 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464790 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464793 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464796 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464799 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464802 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464805 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464807 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.517790 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464810 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464813 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464817 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464823 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464827 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464831 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464834 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464837 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464840 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464843 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464848 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464852 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464855 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464859 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464862 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464865 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464868 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464871 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464874 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464877 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.518361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464880 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464882 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464885 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464888 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464891 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464893 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464896 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464899 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464902 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464904 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464907 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464911 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.464913 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465690 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465698 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465702 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465705 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465710 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465714 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.518979 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465720 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465725 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465728 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465731 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465734 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465737 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465740 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465743 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465746 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465749 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465751 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465755 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465758 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465761 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465764 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465766 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465769 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465773 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465775 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.519550 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465778 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465781 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465783 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465786 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465789 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465792 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465795 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465798 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465801 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465805 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465807 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465810 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465813 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465816 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465819 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465822 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465825 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465827 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465830 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.520266 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465833 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465835 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465838 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465841 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465843 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465846 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465849 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465852 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465855 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465858 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465860 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465863 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465866 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465868 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465871 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465873 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465876 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465879 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465882 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465885 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.520907 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465888 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465890 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465893 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465896 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465898 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465901 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465904 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465907 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465910 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465912 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465915 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465918 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465921 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465924 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465926 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465930 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465935 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465939 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465943 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465946 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.521914 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465949 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465952 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465955 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465958 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465961 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465965 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465967 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465970 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465973 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465976 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465979 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465981 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465984 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465987 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.465989 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466406 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466411 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466415 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466418 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466421 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466424 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.522959 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466427 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466430 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466433 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466436 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466438 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466441 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466444 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466447 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466452 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466455 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466458 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466461 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466464 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466467 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466469 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466472 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466475 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466478 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466480 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466483 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.524000 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466486 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466488 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466491 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466494 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466496 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466501 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466504 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466507 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466510 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466514 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466518 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466521 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466525 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466528 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466532 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466535 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466538 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466541 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466545 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.527118 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466547 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466551 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466554 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466574 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466580 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466583 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466586 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466589 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466592 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466595 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466598 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466600 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466603 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466605 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466608 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466611 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466614 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466617 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466621 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466624 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.527974 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466627 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466630 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466634 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466638 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466641 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466645 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466648 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466650 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466653 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466656 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466658 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466661 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466664 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466669 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466673 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466676 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466679 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466682 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466686 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.528829 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466689 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466692 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466695 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466699 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466702 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466705 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466708 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466711 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466714 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466717 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466720 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466725 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466728 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466730 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.466733 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466799 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466806 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466813 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466817 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466822 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466826 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 14:39:24.529459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466830 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466834 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466838 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466841 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466844 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466849 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466853 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466856 2566 flags.go:64] FLAG: --cgroup-root="" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466860 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466863 2566 flags.go:64] FLAG: --client-ca-file="" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466866 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466869 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466874 2566 flags.go:64] FLAG: --cluster-domain="" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466877 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466880 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466884 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466887 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466891 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466894 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466897 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466901 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466904 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466908 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466912 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 14:39:24.530295 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466915 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466918 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466922 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466926 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466929 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466932 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466935 2566 flags.go:64] FLAG: --enable-server="true" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466939 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466945 2566 flags.go:64] FLAG: --event-burst="100" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466948 2566 flags.go:64] FLAG: --event-qps="50" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466951 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466954 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466958 2566 flags.go:64] FLAG: --eviction-hard="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466964 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466967 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466970 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466973 2566 flags.go:64] FLAG: --eviction-soft="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466976 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466979 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466982 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466985 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466988 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466991 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466994 2566 flags.go:64] FLAG: --feature-gates="" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.466998 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 14:39:24.531166 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467001 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467004 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467007 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467011 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467013 2566 flags.go:64] FLAG: --help="false" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467018 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-137-172.ec2.internal" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467021 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467024 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467027 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467031 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467034 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467038 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467041 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467044 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467047 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467050 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467054 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467056 2566 flags.go:64] FLAG: --kube-reserved="" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467059 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467062 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467067 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467070 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467073 2566 flags.go:64] FLAG: --lock-file="" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467076 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 14:39:24.532447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467079 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467082 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467088 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467091 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467094 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467097 2566 flags.go:64] FLAG: --logging-format="text" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467100 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467103 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467107 2566 flags.go:64] FLAG: --manifest-url="" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467110 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467114 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467117 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467122 2566 flags.go:64] FLAG: --max-pods="110" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467126 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467129 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467133 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467136 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467139 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467142 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467145 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467153 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467157 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467160 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 14:39:24.533670 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467163 2566 flags.go:64] FLAG: --pod-cidr="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467167 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467174 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467177 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467180 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467185 2566 flags.go:64] FLAG: --port="10250" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467188 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467191 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-096cea9b081e5eab8" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467194 2566 flags.go:64] FLAG: --qos-reserved="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467197 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467201 2566 flags.go:64] FLAG: --register-node="true" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467204 2566 flags.go:64] FLAG: --register-with-taints="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467207 2566 flags.go:64] FLAG: --registry-burst="10" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467210 2566 flags.go:64] FLAG: --registry-qps="5" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467213 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467216 2566 flags.go:64] FLAG: --reserved-memory="" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467220 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467223 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467226 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467230 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467233 2566 flags.go:64] FLAG: --runonce="false" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467236 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467239 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467243 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467246 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 14:39:24.696407 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467249 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 14:39:24.535878 ip-10-0-137-172 systemd[1]: Started Kubernetes Kubelet. Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467252 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467255 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467259 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467262 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467265 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467268 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467271 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467275 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467278 2566 flags.go:64] FLAG: --system-cgroups="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467281 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467287 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467292 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467295 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467299 2566 flags.go:64] FLAG: --tls-min-version="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467302 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467305 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467308 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467311 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467314 2566 flags.go:64] FLAG: --v="2" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467318 2566 flags.go:64] FLAG: --version="false" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467322 2566 flags.go:64] FLAG: --vmodule="" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467326 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.467329 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467450 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.716263 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467454 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467457 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467461 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467464 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467467 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467471 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467476 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467480 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467483 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467486 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467488 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467493 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467496 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467500 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467503 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467506 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467509 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467513 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467515 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.717361 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467520 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467523 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467525 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467528 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467531 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467534 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467536 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467539 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467542 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467544 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467547 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467550 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467552 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467555 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467574 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467578 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467581 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467584 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467588 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467591 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.718117 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467594 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467596 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467599 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467602 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467605 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467609 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467612 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467616 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467619 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467622 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467625 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467628 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467632 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467635 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467638 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467640 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467643 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467646 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467649 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.718955 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467652 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467655 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467657 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467660 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467663 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467666 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467669 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467671 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467674 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467677 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467680 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467685 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467687 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467690 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467693 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467696 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467699 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467701 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467704 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467707 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.719616 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467710 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467712 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467715 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467718 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467720 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467725 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467728 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467731 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467734 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467736 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467739 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467742 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467745 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467748 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467750 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467753 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467756 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467758 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467761 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.720317 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.467764 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.468389 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475114 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475130 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475148 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475154 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475214 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475219 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475223 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475226 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475229 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475233 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475236 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475239 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.720995 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475242 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475245 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475248 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475251 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475254 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475257 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475260 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475263 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475266 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475269 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475271 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475274 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475278 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475282 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475285 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475288 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475291 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475293 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475296 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475299 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.721580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475302 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475305 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475308 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475311 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475314 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475317 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475320 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475325 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475328 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475331 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475334 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475337 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475341 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475345 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475348 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475352 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475355 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475358 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475361 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475364 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.722422 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475367 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475370 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475373 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475375 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475378 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475381 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475384 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475387 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475389 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475392 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475395 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475398 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475400 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475403 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475406 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475409 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475412 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475415 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475418 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.723164 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475423 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475426 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475428 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475431 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475434 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475437 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475440 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475443 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475446 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475449 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475452 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475455 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475458 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475461 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475464 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475466 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475469 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475473 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475477 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.723827 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475481 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475484 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475487 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475491 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475494 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475497 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475499 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475502 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475508 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475510 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475513 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475518 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475521 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475528 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475669 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 14:39:24.724499 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475674 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475678 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475681 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475684 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475687 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475690 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475693 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475696 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475699 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475701 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475705 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475708 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475711 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475713 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475716 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475719 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475722 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475724 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475727 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 14:39:24.724992 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475730 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475733 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475736 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475739 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475741 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475744 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475747 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475752 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475755 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475758 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475761 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475765 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475768 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475771 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475774 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475777 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475779 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475782 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475785 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475788 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 14:39:24.725691 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475791 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475793 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475796 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475799 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475803 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475805 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475808 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475811 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475814 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475817 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475820 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475823 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475826 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475829 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475831 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475834 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475838 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475842 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475845 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 14:39:24.726311 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475850 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475855 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475858 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475861 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475865 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475868 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475871 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475874 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475877 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475880 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475883 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475886 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475888 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475891 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475894 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475897 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475899 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475902 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475905 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475908 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 14:39:24.727005 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475911 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475913 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475917 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475921 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475924 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475927 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475930 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475933 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475937 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475940 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475943 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475946 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475950 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475953 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475956 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475959 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475963 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475967 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475970 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 14:39:24.727611 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:24.475973 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.475978 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.476083 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.479068 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.480534 2566 server.go:1019] "Starting client certificate rotation" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.480647 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.480690 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.482932 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.487082 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.499144 2566 log.go:25] "Validated CRI v1 runtime API" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.501973 2566 log.go:25] "Validated CRI v1 image API" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.503474 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 14:39:24.728264 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.506015 2566 fs.go:135] Filesystem UUIDs: map[332a745b-057b-4836-aa69-c2e75f8bfaec:/dev/nvme0n1p4 3f0a1948-a795-4bec-a413-59b7e0fb19bf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 14:39:24.867947 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.506034 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 14:39:24.867947 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.511292 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.511684 2566 manager.go:216] Machine: {Timestamp:2026-07-01 14:39:24.510924927 +0000 UTC m=+0.322608111 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101791 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff3c0dd70ae90d67cb2459c801dd7 SystemUUID:ec2ff3c0-dd70-ae90-d67c-b2459c801dd7 BootID:1d2c8199-bf64-4b73-a63d-a3e98661d998 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:74:6a:71:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:74:6a:71:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:d4:c0:e4:82:03 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.511820 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.511921 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.514894 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.514921 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.515578 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.515589 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.515597 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.515609 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.516342 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519516 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519646 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519679 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519689 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519706 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519717 2566 kubelet.go:398] "Adding apiserver pod source" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.519726 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 14:39:24.869775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.520117 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.520134 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.522199 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.523712 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.523755 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524391 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524418 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524430 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524444 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524463 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524475 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524492 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524511 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.524527 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.528828 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.528852 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.528861 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.528889 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.528894 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.532242 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.532729 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.532739 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.534541 2566 server.go:1268] "Started kubelet" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.534659 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.534707 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.534804 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.535861 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.536039 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.538946 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-172.ec2.internal.18be3159de2b09d0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-172.ec2.internal,UID:ip-10-0-137-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-172.ec2.internal,},FirstTimestamp:2026-07-01 14:39:24.534507984 +0000 UTC m=+0.346191169,LastTimestamp:2026-07-01 14:39:24.534507984 +0000 UTC m=+0.346191169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-172.ec2.internal,}" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.540715 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.541117 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfl4v" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542095 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542111 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.542173 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542665 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542671 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542686 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542781 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.542791 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.543039 2566 factory.go:55] Registering systemd factory Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.543054 2566 factory.go:223] Registration of the systemd container factory successfully Jul 01 14:39:24.870410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.544903 2566 factory.go:153] Registering CRI-O factory Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.544917 2566 factory.go:223] Registration of the crio container factory successfully Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.544967 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.544988 2566 factory.go:103] Registering Raw factory Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.545000 2566 manager.go:1196] Started watching for new ooms in manager Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.545500 2566 manager.go:349] Starting recovery of all containers Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.550244 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfl4v" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.552390 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.556150 2566 manager.go:354] Recovery completed Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.556173 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.556202 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.564055 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.566397 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.566432 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.566448 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567064 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567064 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567137 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567159 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567816 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567851 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.567863 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.568190 2566 policy_none.go:49] "None policy: Start" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.568204 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.568216 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.569227 2566 policy_none.go:47] "Start" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.608834 2566 manager.go:337] "Starting Device Plugin manager" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.608870 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.608880 2566 server.go:87] "Starting device plugin registration server" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.609175 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.609188 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.609279 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.609368 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.609375 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.609949 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.610010 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.625204 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.625253 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.625283 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.625330 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.627790 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.709533 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.710664 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.710699 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.710711 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.710738 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.030019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.718735 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.718757 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-172.ec2.internal\": node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.725456 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal"] Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.725534 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.726882 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.726913 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.726926 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.729786 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.729821 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.730146 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.730553 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.730597 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.730613 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.731455 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.731473 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.731482 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.733089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.733114 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.733808 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientMemory" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.733829 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.733839 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeHasSufficientPID" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.750093 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.753522 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-172.ec2.internal\" not found" node="ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.758350 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-172.ec2.internal\" not found" node="ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.843941 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.843971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.843990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d2f8c8a24b804aabf001b0ab0732993-config\") pod \"kube-apiserver-proxy-ip-10-0-137-172.ec2.internal\" (UID: \"1d2f8c8a24b804aabf001b0ab0732993\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.851309 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.031880 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.032776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d2f8c8a24b804aabf001b0ab0732993-config\") pod \"kube-apiserver-proxy-ip-10-0-137-172.ec2.internal\" (UID: \"1d2f8c8a24b804aabf001b0ab0732993\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.032776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.032776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d2f8c8a24b804aabf001b0ab0732993-config\") pod \"kube-apiserver-proxy-ip-10-0-137-172.ec2.internal\" (UID: \"1d2f8c8a24b804aabf001b0ab0732993\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.032776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:24.945251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436ed0a47cd71d90f33bc0533d0c75b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal\" (UID: \"436ed0a47cd71d90f33bc0533d0c75b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.032776 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:24.951658 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.222920 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.051884 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.222920 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.057164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.222920 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.061572 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.222920 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.153003 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.399827 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.254124 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.399827 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.354844 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-172.ec2.internal\" not found" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.418754 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.443060 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.464939 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.468052 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.479771 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.479795 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.479934 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.479978 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 14:39:25.533001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.520384 2566 apiserver.go:52] "Watching apiserver" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.542534 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.544451 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.546398 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal","openshift-cluster-node-tuning-operator/tuned-g2gns","openshift-dns/node-resolver-s95lc","openshift-image-registry/node-ca-r868z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal","openshift-multus/multus-zfc2w","openshift-network-diagnostics/network-check-target-bgqt2","kube-system/konnectivity-agent-xvglq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn","openshift-multus/multus-additional-cni-plugins-95ctp","openshift-multus/network-metrics-daemon-5sll4","openshift-network-operator/iptables-alerter-5pdr8","openshift-ovn-kubernetes/ovnkube-node-tj8xd","kube-system/global-pull-secret-syncer-hkm8p"] Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.555630 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 14:34:25 +0000 UTC" deadline="2028-02-14 08:14:38.330470537 +0000 UTC" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.555676 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14225h35m12.774798169s" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.555764 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.555822 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.557432 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.557491 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.558069 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.559651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.560949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.561003 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.562424 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.563345 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9b5t4\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.563521 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.564284 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.564440 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.564451 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.565213 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.565584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.565875 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.566359 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9tqs\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.566767 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.566963 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fr5m7\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.566980 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.567312 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.568159 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.662668 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.568933 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.569053 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.569866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.570752 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.570809 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.571425 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.572711 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.574298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578655 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578731 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578731 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578771 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578783 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.578790 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rmjxk\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.579750 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.579803 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.579879 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjqkd\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.579910 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580003 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580027 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580142 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j88gg\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580345 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7rpj\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580379 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.580618 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phlgx\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.582228 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.582550 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2j24w\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.582649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.583293 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.591767 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-skjbj" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.599708 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436ed0a47cd71d90f33bc0533d0c75b6.slice/crio-23ff2b6eb47e27301eedacfbd0f40e5ec31ff78cf0986f70bd1eb8c7fbde7dba WatchSource:0}: Error finding container 23ff2b6eb47e27301eedacfbd0f40e5ec31ff78cf0986f70bd1eb8c7fbde7dba: Status 404 returned error can't find the container with id 23ff2b6eb47e27301eedacfbd0f40e5ec31ff78cf0986f70bd1eb8c7fbde7dba Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.603373 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-skjbj" Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.604811 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.628722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" event={"ID":"436ed0a47cd71d90f33bc0533d0c75b6","Type":"ContainerStarted","Data":"23ff2b6eb47e27301eedacfbd0f40e5ec31ff78cf0986f70bd1eb8c7fbde7dba"} Jul 01 14:39:25.664580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.643771 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfb7l\" (UniqueName: \"kubernetes.io/projected/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-kube-api-access-bfb7l\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-socket-dir-parent\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwhh\" (UniqueName: \"kubernetes.io/projected/f0c21246-4532-4acb-8b7a-984b3401ba47-kube-api-access-2pwhh\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-etc-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-ovn\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysconfig\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-tuned\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwt54\" (UniqueName: \"kubernetes.io/projected/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-kube-api-access-zwt54\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-kubelet-config\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-kubelet\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-device-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-sys-fs\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.665733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-node-log\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076fa509-880f-42cd-be0e-a75d973a1d82-ovn-node-metrics-cert\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-conf\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.650987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-host\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-bin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-script-lib\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-tmp\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-iptables-alerter-script\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af32473b-d0ec-4dc2-8452-f218e629e923-hosts-file\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-dbus\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-multus\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-multus-certs\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.666456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-var-lib-kubelet\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-binary-copy\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-k8s-cni-cncf-io\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-var-lib-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-host\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-host-slash\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651427 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-cnibin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651459 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-etc-kubernetes\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttgw\" (UniqueName: \"kubernetes.io/projected/f82ce774-e750-4c54-9195-ff4743f8ae0d-kube-api-access-jttgw\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-systemd\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfv9\" (UniqueName: \"kubernetes.io/projected/af32473b-d0ec-4dc2-8452-f218e629e923-kube-api-access-7kfv9\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.667106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-daemon-config\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jffcf\" (UniqueName: \"kubernetes.io/projected/478b1e87-9842-4629-a6cf-993cc6609979-kube-api-access-jffcf\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-registration-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-systemd-units\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-cnibin\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6871e29f-d49d-43b2-af91-5593fbb95190-agent-certs\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thl2\" (UniqueName: \"kubernetes.io/projected/199cf7ce-2384-4654-a6c2-fbe512e4affc-kube-api-access-5thl2\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-etc-selinux\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-hostroot\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-kubelet\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-kubernetes\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-sys\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-socket-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-system-cni-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-os-release\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-bin\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.667790 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8m4b\" (UniqueName: \"kubernetes.io/projected/076fa509-880f-42cd-be0e-a75d973a1d82-kube-api-access-x8m4b\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-modprobe-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6871e29f-d49d-43b2-af91-5593fbb95190-konnectivity-ca\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af32473b-d0ec-4dc2-8452-f218e629e923-tmp-dir\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-netns\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-netns\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-systemd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-log-socket\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.651989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-netd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-serviceca\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-cni-binary-copy\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-conf-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-config\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-env-overrides\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8l7z\" (UniqueName: \"kubernetes.io/projected/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-kube-api-access-b8l7z\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-run\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-lib-modules\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.668371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-system-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.669186 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-slash\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.669186 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.652212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-os-release\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752637 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-iptables-alerter-script\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af32473b-d0ec-4dc2-8452-f218e629e923-hosts-file\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-dbus\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-multus\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-multus-certs\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af32473b-d0ec-4dc2-8452-f218e629e923-hosts-file\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-var-lib-kubelet\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-multus-certs\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-multus\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-binary-copy\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-dbus\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-var-lib-kubelet\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.840609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.752996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-k8s-cni-cncf-io\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-var-lib-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-host\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753063 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-k8s-cni-cncf-io\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753076 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-host-slash\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753107 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-var-lib-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.753112 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-host\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-host-slash\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.753220 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:26.253194028 +0000 UTC m=+2.064877223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.753227 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.753289 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:26.253270372 +0000 UTC m=+2.064953543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:25.841491 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-cnibin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753330 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-iptables-alerter-script\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-etc-kubernetes\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-etc-kubernetes\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-binary-copy\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-cnibin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttgw\" (UniqueName: \"kubernetes.io/projected/f82ce774-e750-4c54-9195-ff4743f8ae0d-kube-api-access-jttgw\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753446 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-systemd\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-systemd\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfv9\" (UniqueName: \"kubernetes.io/projected/af32473b-d0ec-4dc2-8452-f218e629e923-kube-api-access-7kfv9\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-daemon-config\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jffcf\" (UniqueName: \"kubernetes.io/projected/478b1e87-9842-4629-a6cf-993cc6609979-kube-api-access-jffcf\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-registration-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-systemd-units\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-cnibin\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-registration-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.842604 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-systemd-units\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6871e29f-d49d-43b2-af91-5593fbb95190-agent-certs\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-cnibin\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thl2\" (UniqueName: \"kubernetes.io/projected/199cf7ce-2384-4654-a6c2-fbe512e4affc-kube-api-access-5thl2\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-etc-selinux\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-hostroot\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-kubelet\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-hostroot\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-kubernetes\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-sys\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-etc-selinux\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753892 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-socket-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-kubelet\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-kubernetes\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-system-cni-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-os-release\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753958 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-system-cni-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-bin\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.843473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.753940 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-sys\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754012 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-socket-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754014 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8m4b\" (UniqueName: \"kubernetes.io/projected/076fa509-880f-42cd-be0e-a75d973a1d82-kube-api-access-x8m4b\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-daemon-config\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754054 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-os-release\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-bin\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-modprobe-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6871e29f-d49d-43b2-af91-5593fbb95190-konnectivity-ca\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af32473b-d0ec-4dc2-8452-f218e629e923-tmp-dir\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-modprobe-d\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-netns\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-netns\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-systemd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-log-socket\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-netd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754230 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-run-netns\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754236 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-log-socket\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.844359 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-serviceca\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-netns\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-systemd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-cni-binary-copy\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-conf-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-config\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-cni-netd\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-env-overrides\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8l7z\" (UniqueName: \"kubernetes.io/projected/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-kube-api-access-b8l7z\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-run\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-lib-modules\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af32473b-d0ec-4dc2-8452-f218e629e923-tmp-dir\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-system-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-slash\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-os-release\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfb7l\" (UniqueName: \"kubernetes.io/projected/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-kube-api-access-bfb7l\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-socket-dir-parent\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwhh\" (UniqueName: \"kubernetes.io/projected/f0c21246-4532-4acb-8b7a-984b3401ba47-kube-api-access-2pwhh\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.845305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754648 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-system-cni-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-slash\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-etc-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-ovn\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-os-release\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6871e29f-d49d-43b2-af91-5593fbb95190-konnectivity-ca\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysconfig\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754806 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-tuned\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754813 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82ce774-e750-4c54-9195-ff4743f8ae0d-cni-binary-copy\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysconfig\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwt54\" (UniqueName: \"kubernetes.io/projected/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-kube-api-access-zwt54\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754863 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-run\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-kubelet-config\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754912 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.845971 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-kubelet\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-etc-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/478b1e87-9842-4629-a6cf-993cc6609979-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-device-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-ovn\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-conf-dir\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-lib-modules\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755028 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-run-openvswitch\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-sys-fs\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-sys-fs\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-node-log\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c21246-4532-4acb-8b7a-984b3401ba47-device-dir\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755106 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-node-log\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076fa509-880f-42cd-be0e-a75d973a1d82-ovn-node-metrics-cert\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755110 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-kubelet-config\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-config\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755120 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-env-overrides\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.754753 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-serviceca\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.846587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755163 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-multus-socket-dir-parent\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.755211 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-kubelet\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.757962 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076fa509-880f-42cd-be0e-a75d973a1d82-ovn-node-metrics-cert\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.758049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6871e29f-d49d-43b2-af91-5593fbb95190-agent-certs\") pod \"konnectivity-agent-xvglq\" (UID: \"6871e29f-d49d-43b2-af91-5593fbb95190\") " pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-conf\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-host\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-bin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760608 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f82ce774-e750-4c54-9195-ff4743f8ae0d-host-var-lib-cni-bin\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760616 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-host\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-script-lib\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-tmp\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-sysctl-conf\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.760739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076fa509-880f-42cd-be0e-a75d973a1d82-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.761043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/478b1e87-9842-4629-a6cf-993cc6609979-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.847215 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.761172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076fa509-880f-42cd-be0e-a75d973a1d82-ovnkube-script-lib\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.762375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-etc-tuned\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.762527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-tmp\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.775651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thl2\" (UniqueName: \"kubernetes.io/projected/199cf7ce-2384-4654-a6c2-fbe512e4affc-kube-api-access-5thl2\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.780062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfv9\" (UniqueName: \"kubernetes.io/projected/af32473b-d0ec-4dc2-8452-f218e629e923-kube-api-access-7kfv9\") pod \"node-resolver-s95lc\" (UID: \"af32473b-d0ec-4dc2-8452-f218e629e923\") " pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.780324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwt54\" (UniqueName: \"kubernetes.io/projected/3c548c18-bb77-4fcc-9c9c-3a59c8875b31-kube-api-access-zwt54\") pod \"tuned-g2gns\" (UID: \"3c548c18-bb77-4fcc-9c9c-3a59c8875b31\") " pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.781700 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8m4b\" (UniqueName: \"kubernetes.io/projected/076fa509-880f-42cd-be0e-a75d973a1d82-kube-api-access-x8m4b\") pod \"ovnkube-node-tj8xd\" (UID: \"076fa509-880f-42cd-be0e-a75d973a1d82\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.782658 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfb7l\" (UniqueName: \"kubernetes.io/projected/5fa63f6c-5c19-49bb-8a74-90f3af56c14a-kube-api-access-bfb7l\") pod \"iptables-alerter-5pdr8\" (UID: \"5fa63f6c-5c19-49bb-8a74-90f3af56c14a\") " pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.784184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jffcf\" (UniqueName: \"kubernetes.io/projected/478b1e87-9842-4629-a6cf-993cc6609979-kube-api-access-jffcf\") pod \"multus-additional-cni-plugins-95ctp\" (UID: \"478b1e87-9842-4629-a6cf-993cc6609979\") " pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.785856 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttgw\" (UniqueName: \"kubernetes.io/projected/f82ce774-e750-4c54-9195-ff4743f8ae0d-kube-api-access-jttgw\") pod \"multus-zfc2w\" (UID: \"f82ce774-e750-4c54-9195-ff4743f8ae0d\") " pod="openshift-multus/multus-zfc2w" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.787384 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.787400 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.787412 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:25.787474 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:26.287459422 +0000 UTC m=+2.099142607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.788057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwhh\" (UniqueName: \"kubernetes.io/projected/f0c21246-4532-4acb-8b7a-984b3401ba47-kube-api-access-2pwhh\") pod \"aws-ebs-csi-driver-node-v78kn\" (UID: \"f0c21246-4532-4acb-8b7a-984b3401ba47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.790106 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8l7z\" (UniqueName: \"kubernetes.io/projected/f71da8cc-1f71-4a7b-bc48-35d8978bec7a-kube-api-access-b8l7z\") pod \"node-ca-r868z\" (UID: \"f71da8cc-1f71-4a7b-bc48-35d8978bec7a\") " pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:25.847821 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.845051 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.882931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s95lc" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.888413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r868z" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.893851 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf32473b_d0ec_4dc2_8452_f218e629e923.slice/crio-9cded0d85fb13a4c16fb26ad611c7ed4d885bfd4be378e5c61f5fb1330182a3c WatchSource:0}: Error finding container 9cded0d85fb13a4c16fb26ad611c7ed4d885bfd4be378e5c61f5fb1330182a3c: Status 404 returned error can't find the container with id 9cded0d85fb13a4c16fb26ad611c7ed4d885bfd4be378e5c61f5fb1330182a3c Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.897343 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71da8cc_1f71_4a7b_bc48_35d8978bec7a.slice/crio-3d6626ea50dfe35979f3b10f956fc2d3adc734aa35ab70d29bf80c1e30ae3325 WatchSource:0}: Error finding container 3d6626ea50dfe35979f3b10f956fc2d3adc734aa35ab70d29bf80c1e30ae3325: Status 404 returned error can't find the container with id 3d6626ea50dfe35979f3b10f956fc2d3adc734aa35ab70d29bf80c1e30ae3325 Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.907124 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfc2w" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.913118 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.914215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.918165 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82ce774_e750_4c54_9195_ff4743f8ae0d.slice/crio-8c2992cf937064147a203dc220e20c70a74f1dcf62656e3bf481c9cd43759caf WatchSource:0}: Error finding container 8c2992cf937064147a203dc220e20c70a74f1dcf62656e3bf481c9cd43759caf: Status 404 returned error can't find the container with id 8c2992cf937064147a203dc220e20c70a74f1dcf62656e3bf481c9cd43759caf Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.918793 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.923643 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c21246_4532_4acb_8b7a_984b3401ba47.slice/crio-0d6a4972f132f7fb507f00dd930e2a3e292b7ddeefdd8b48fd63be3b80fe4e05 WatchSource:0}: Error finding container 0d6a4972f132f7fb507f00dd930e2a3e292b7ddeefdd8b48fd63be3b80fe4e05: Status 404 returned error can't find the container with id 0d6a4972f132f7fb507f00dd930e2a3e292b7ddeefdd8b48fd63be3b80fe4e05 Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.924384 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g2gns" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.934360 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95ctp" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.935163 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076fa509_880f_42cd_be0e_a75d973a1d82.slice/crio-af9be003a6e7077013bc9cc28d7b34e1fbdc8357648b61fe5d1acd106bccaedb WatchSource:0}: Error finding container af9be003a6e7077013bc9cc28d7b34e1fbdc8357648b61fe5d1acd106bccaedb: Status 404 returned error can't find the container with id af9be003a6e7077013bc9cc28d7b34e1fbdc8357648b61fe5d1acd106bccaedb Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.938088 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c548c18_bb77_4fcc_9c9c_3a59c8875b31.slice/crio-3b735a1b25505d00419098c2c7d47e533a4ed6575731171e4fa20022acb81bec WatchSource:0}: Error finding container 3b735a1b25505d00419098c2c7d47e533a4ed6575731171e4fa20022acb81bec: Status 404 returned error can't find the container with id 3b735a1b25505d00419098c2c7d47e533a4ed6575731171e4fa20022acb81bec Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.939590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.947799 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6871e29f_d49d_43b2_af91_5593fbb95190.slice/crio-296f01281105d60203ae930541debe42e3ef39fccff146f69ac9d9cf76e4df28 WatchSource:0}: Error finding container 296f01281105d60203ae930541debe42e3ef39fccff146f69ac9d9cf76e4df28: Status 404 returned error can't find the container with id 296f01281105d60203ae930541debe42e3ef39fccff146f69ac9d9cf76e4df28 Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:25.948394 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pdr8" Jul 01 14:39:26.002495 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:25.957057 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa63f6c_5c19_49bb_8a74_90f3af56c14a.slice/crio-24aadd33730a830acb0e751315bbeafe2d92ab03e07beeac2055beb46cec8c43 WatchSource:0}: Error finding container 24aadd33730a830acb0e751315bbeafe2d92ab03e07beeac2055beb46cec8c43: Status 404 returned error can't find the container with id 24aadd33730a830acb0e751315bbeafe2d92ab03e07beeac2055beb46cec8c43 Jul 01 14:39:26.177788 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:39:26.027642 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2f8c8a24b804aabf001b0ab0732993.slice/crio-ea69d33aa0922f9a22956ee0a9a1204387c86d0ef24d757c88b9238503675822 WatchSource:0}: Error finding container ea69d33aa0922f9a22956ee0a9a1204387c86d0ef24d757c88b9238503675822: Status 404 returned error can't find the container with id ea69d33aa0922f9a22956ee0a9a1204387c86d0ef24d757c88b9238503675822 Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.263447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.263492 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.263634 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.263695 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:27.263677226 +0000 UTC m=+3.075360398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.264069 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:26.358176 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.264109 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:27.264096959 +0000 UTC m=+3.075780129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:26.430627 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.364019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:26.430627 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.364673 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:26.430627 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.364697 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:26.430627 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.364711 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:26.430627 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.364783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:27.364761727 +0000 UTC m=+3.176444903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:26.606615 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.606536 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 14:34:26 +0000 UTC" deadline="2028-01-27 03:14:10.590191902 +0000 UTC" Jul 01 14:39:26.606615 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.606612 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13788h34m43.983584141s" Jul 01 14:39:26.626090 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.626059 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:26.626279 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.626060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:26.626279 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.626226 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:26.626409 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:26.626296 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:26.638092 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.638024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pdr8" event={"ID":"5fa63f6c-5c19-49bb-8a74-90f3af56c14a","Type":"ContainerStarted","Data":"24aadd33730a830acb0e751315bbeafe2d92ab03e07beeac2055beb46cec8c43"} Jul 01 14:39:26.640644 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.640589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g2gns" event={"ID":"3c548c18-bb77-4fcc-9c9c-3a59c8875b31","Type":"ContainerStarted","Data":"3b735a1b25505d00419098c2c7d47e533a4ed6575731171e4fa20022acb81bec"} Jul 01 14:39:26.643747 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.643717 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" event={"ID":"f0c21246-4532-4acb-8b7a-984b3401ba47","Type":"ContainerStarted","Data":"0d6a4972f132f7fb507f00dd930e2a3e292b7ddeefdd8b48fd63be3b80fe4e05"} Jul 01 14:39:26.652889 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.652852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfc2w" event={"ID":"f82ce774-e750-4c54-9195-ff4743f8ae0d","Type":"ContainerStarted","Data":"8c2992cf937064147a203dc220e20c70a74f1dcf62656e3bf481c9cd43759caf"} Jul 01 14:39:26.657248 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.657214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r868z" event={"ID":"f71da8cc-1f71-4a7b-bc48-35d8978bec7a","Type":"ContainerStarted","Data":"3d6626ea50dfe35979f3b10f956fc2d3adc734aa35ab70d29bf80c1e30ae3325"} Jul 01 14:39:26.665449 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.665055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s95lc" event={"ID":"af32473b-d0ec-4dc2-8452-f218e629e923","Type":"ContainerStarted","Data":"9cded0d85fb13a4c16fb26ad611c7ed4d885bfd4be378e5c61f5fb1330182a3c"} Jul 01 14:39:26.671161 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.671123 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvglq" event={"ID":"6871e29f-d49d-43b2-af91-5593fbb95190","Type":"ContainerStarted","Data":"296f01281105d60203ae930541debe42e3ef39fccff146f69ac9d9cf76e4df28"} Jul 01 14:39:26.677593 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.677527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerStarted","Data":"09e00c98d815c568335831ee9dac4b2998a12a4d7dd711c044ff4c8bb9ee11ac"} Jul 01 14:39:26.693504 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.693416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"af9be003a6e7077013bc9cc28d7b34e1fbdc8357648b61fe5d1acd106bccaedb"} Jul 01 14:39:26.708775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.708735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" event={"ID":"1d2f8c8a24b804aabf001b0ab0732993","Type":"ContainerStarted","Data":"ea69d33aa0922f9a22956ee0a9a1204387c86d0ef24d757c88b9238503675822"} Jul 01 14:39:26.755873 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:26.755654 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:27.272968 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.272931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:27.273187 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.272984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:27.273187 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.273123 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:27.273316 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.273206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:29.273183764 +0000 UTC m=+5.084866962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:27.273584 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.273128 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:27.273679 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.273607 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:29.273590707 +0000 UTC m=+5.085273883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:27.373946 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.373906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:27.374135 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.374116 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:27.374214 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.374147 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:27.374214 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.374162 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:27.374331 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.374223 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:29.374203486 +0000 UTC m=+5.185886662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:27.607173 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.607086 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 14:34:26 +0000 UTC" deadline="2028-03-08 11:06:50.106987354 +0000 UTC" Jul 01 14:39:27.607173 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.607125 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14780h27m22.499866944s" Jul 01 14:39:27.625741 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:27.625705 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:27.625928 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:27.625849 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:28.356567 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:28.356273 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 14:39:28.629970 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:28.628669 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:28.629970 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:28.628809 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:28.629970 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:28.629482 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:28.631081 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:28.631008 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:29.288954 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:29.288918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:29.289138 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:29.288967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:29.289138 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.289094 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:29.289271 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.289157 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:33.289138378 +0000 UTC m=+9.100821550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:29.289271 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.289227 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:29.289271 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.289265 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:33.289251758 +0000 UTC m=+9.100934932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:29.391019 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:29.390300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:29.391019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.390551 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:29.391019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.390573 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:29.391019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.390587 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:29.391019 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.390648 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:33.39062878 +0000 UTC m=+9.202311956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:29.625815 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:29.625721 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:29.625989 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:29.625870 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:30.626720 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:30.626680 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:30.627245 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:30.626811 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:30.627245 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:30.627200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:30.627369 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:30.627323 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:31.626353 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:31.625834 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:31.626353 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:31.625989 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:32.626276 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:32.626234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:32.626879 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:32.626293 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:32.626879 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:32.626400 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:32.626879 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:32.626536 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:33.334924 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:33.334882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:33.335146 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:33.334944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:33.335146 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.335027 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:33.335146 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.335042 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:33.335146 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.335094 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:41.335074132 +0000 UTC m=+17.146757307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:33.335146 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.335114 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:41.335104163 +0000 UTC m=+17.146787334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:33.435280 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:33.435239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:33.435450 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.435409 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:33.435450 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.435426 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:33.435450 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.435435 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:33.435639 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.435480 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:41.435466943 +0000 UTC m=+17.247150111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:33.625953 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:33.625875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:33.626142 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:33.626012 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:34.626846 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:34.626812 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:34.626846 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:34.626891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:34.627548 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:34.627006 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:34.627548 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:34.627451 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:35.626072 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:35.626037 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:35.626229 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:35.626145 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:36.626257 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:36.626161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:36.626753 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:36.626325 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:36.626753 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:36.626374 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:36.626753 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:36.626474 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:37.626130 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:37.626097 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:37.626288 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:37.626206 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:38.626198 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:38.626157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:38.626402 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:38.626156 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:38.626402 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:38.626298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:38.626402 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:38.626351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:39.626464 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:39.626431 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:39.626914 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:39.626567 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:40.626148 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:40.626111 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:40.626317 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:40.626107 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:40.626317 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:40.626251 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:40.626430 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:40.626332 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:41.399196 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:41.399154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:41.399664 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:41.399208 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:41.399664 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.399340 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:41.399664 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.399379 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:41.399664 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.399416 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:39:57.399399476 +0000 UTC m=+33.211082644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:41.399664 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.399432 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:39:57.399425594 +0000 UTC m=+33.211108763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:41.499925 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:41.499895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:41.500133 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.500109 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:41.500228 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.500138 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:41.500228 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.500152 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:41.500228 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.500213 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:39:57.500192309 +0000 UTC m=+33.311875486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:41.625954 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:41.625924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:41.626131 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:41.626049 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:42.626323 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:42.626284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:42.626785 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:42.626284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:42.626785 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:42.626424 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:42.626785 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:42.626555 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:43.626259 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:43.626228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:43.626441 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:43.626339 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:44.627179 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:44.627145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:44.627583 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:44.627207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:44.627583 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:44.627325 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:44.627583 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:44.627437 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:45.626382 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:45.626339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:45.626569 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:45.626469 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:46.629552 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.629388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:46.629932 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.629450 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:46.629932 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:46.629676 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:46.629932 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:46.629775 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:46.760788 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.760676 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" event={"ID":"1d2f8c8a24b804aabf001b0ab0732993","Type":"ContainerStarted","Data":"5bd1f67762d18f0baf153f38ba25f5f2f0b64ab24f73fa7fcbd083970352bacb"} Jul 01 14:39:46.766303 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.766128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g2gns" event={"ID":"3c548c18-bb77-4fcc-9c9c-3a59c8875b31","Type":"ContainerStarted","Data":"17298a03fb64ddd660a4828caabe56456466cd969c49fd7a3ad1938246c2daeb"} Jul 01 14:39:46.770856 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.770829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfc2w" event={"ID":"f82ce774-e750-4c54-9195-ff4743f8ae0d","Type":"ContainerStarted","Data":"7285742567a5ffef39f364e365eb48862dc480529f7fddaf625b50437a41bccf"} Jul 01 14:39:46.773543 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.773426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"4eb653a2546ad43df578592b940d55e37eaaf36296a2a95e1a71d6d7b6a1afc5"} Jul 01 14:39:46.779769 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.779712 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-172.ec2.internal" podStartSLOduration=20.779695978 podStartE2EDuration="20.779695978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:46.77955748 +0000 UTC m=+22.591240673" watchObservedRunningTime="2026-07-01 14:39:46.779695978 +0000 UTC m=+22.591379182" Jul 01 14:39:46.799769 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:46.799717 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g2gns" podStartSLOduration=1.196842906 podStartE2EDuration="21.799697029s" totalImagesPullingTime="20.602854123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:46.79911753 +0000 UTC m=+22.610800721" watchObservedRunningTime="2026-07-01 14:39:46.799697029 +0000 UTC m=+22.611380220" Jul 01 14:39:47.626355 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.626183 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:47.626556 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:47.626457 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:47.779228 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779005 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779650 2566 generic.go:356] "Generic (PLEG): container finished" podID="076fa509-880f-42cd-be0e-a75d973a1d82" containerID="1c2d4ab29be9ae9c32b127c2e3fbe169ae8c17eddd1d20b623f47f79fd550b32" exitCode=1 Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779730 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"91c96e41213f9b36add57170e3ffba9c876e10aca2d13bc8d7a63a442af6f7a9"} Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"1e35e314109556c09fc2c498e22ec8befcdfc5436cfc97f5137093bf65808046"} Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779870 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"20903f77d48c7a2060d160c5c50e756c3893a5e4ac17fb3e43d3687b7f98f2b7"} Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"138694c7ab1ac8f3005052ef6ec37a4bac429281957fac349efcba74465abf37"} Jul 01 14:39:47.780024 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.779966 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerDied","Data":"1c2d4ab29be9ae9c32b127c2e3fbe169ae8c17eddd1d20b623f47f79fd550b32"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.781225 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" event={"ID":"f0c21246-4532-4acb-8b7a-984b3401ba47","Type":"ContainerStarted","Data":"7b1c43f17a35458d959ecd154a2e113b623794ab1d2f7a7a4ac37cd75a1872e1"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.782611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r868z" event={"ID":"f71da8cc-1f71-4a7b-bc48-35d8978bec7a","Type":"ContainerStarted","Data":"e7005a72e539a5658e753bf3fce6ffa6b3f9be1bd7073d0708579b43060d1f2f"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.784235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s95lc" event={"ID":"af32473b-d0ec-4dc2-8452-f218e629e923","Type":"ContainerStarted","Data":"d19644a747693e6631e5c1e6830b0f27db461883ffd28d203cff30befc927a7e"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.785759 2566 generic.go:356] "Generic (PLEG): container finished" podID="436ed0a47cd71d90f33bc0533d0c75b6" containerID="a4ebe54bc50df36cc20788b0b5aab1c6608bae3ce4504aa7d392e04ba9e8b686" exitCode=0 Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.785824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" event={"ID":"436ed0a47cd71d90f33bc0533d0c75b6","Type":"ContainerDied","Data":"a4ebe54bc50df36cc20788b0b5aab1c6608bae3ce4504aa7d392e04ba9e8b686"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.787524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvglq" event={"ID":"6871e29f-d49d-43b2-af91-5593fbb95190","Type":"ContainerStarted","Data":"3afb0952a45fc745b252ebca4294254b9897721382fdde8a4e75537d92a4be43"} Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.789257 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="e693eec33f8536b2a11bccedd482ebf016f897eabedf89763b633f3b0ce7b749" exitCode=0 Jul 01 14:39:47.790602 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.789338 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"e693eec33f8536b2a11bccedd482ebf016f897eabedf89763b633f3b0ce7b749"} Jul 01 14:39:47.802213 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.802168 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r868z" podStartSLOduration=2.176130722 podStartE2EDuration="22.802156655s" totalImagesPullingTime="20.626025933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:47.801888185 +0000 UTC m=+23.613571377" watchObservedRunningTime="2026-07-01 14:39:47.802156655 +0000 UTC m=+23.613839846" Jul 01 14:39:47.802334 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.802287 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zfc2w" podStartSLOduration=2.157165673 podStartE2EDuration="22.802279251s" totalImagesPullingTime="20.645113578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:46.819752115 +0000 UTC m=+22.631435307" watchObservedRunningTime="2026-07-01 14:39:47.802279251 +0000 UTC m=+23.613962445" Jul 01 14:39:47.822532 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:47.822475 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xvglq" podStartSLOduration=2.232036952 podStartE2EDuration="22.822463154s" totalImagesPullingTime="20.590426202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:47.822451852 +0000 UTC m=+23.634135042" watchObservedRunningTime="2026-07-01 14:39:47.822463154 +0000 UTC m=+23.634146345" Jul 01 14:39:48.258455 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.258430 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 14:39:48.513347 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.513260 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:48.513916 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.513895 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:48.546106 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.546056 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s95lc" podStartSLOduration=2.916376349 podStartE2EDuration="23.5460361s" totalImagesPullingTime="20.629659751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:47.89371777 +0000 UTC m=+23.705400951" watchObservedRunningTime="2026-07-01 14:39:48.5460361 +0000 UTC m=+24.357719292" Jul 01 14:39:48.624449 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.624335 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T14:39:48.258452037Z","UUID":"5031d4fd-d2cc-4225-b461-3a8c29d81214","Handler":null,"Name":"","Endpoint":""} Jul 01 14:39:48.625623 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.625597 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:48.625750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.625733 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:48.625750 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:48.625732 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:48.625855 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:48.625831 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:48.626473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.626449 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 14:39:48.626587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.626522 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 14:39:48.794058 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.793969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pdr8" event={"ID":"5fa63f6c-5c19-49bb-8a74-90f3af56c14a","Type":"ContainerStarted","Data":"f290822ced580390ac6fe6c86b0dbcece8fff61010df65f861e30da62a2f9950"} Jul 01 14:39:48.796609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.796578 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" event={"ID":"f0c21246-4532-4acb-8b7a-984b3401ba47","Type":"ContainerStarted","Data":"ab300c6b10425b30672176a2813f6446df3e0f44f985623c7e7dd9be5d9a65b6"} Jul 01 14:39:48.798847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.798824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" event={"ID":"436ed0a47cd71d90f33bc0533d0c75b6","Type":"ContainerStarted","Data":"674b0646b797e7a33fd21bfc029b5cda9a6aecb7bf799287ad3a1b6d678a29d7"} Jul 01 14:39:48.799072 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.799054 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:48.799990 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.799973 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xvglq" Jul 01 14:39:48.842133 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:48.841792 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5pdr8" podStartSLOduration=3.274674348 podStartE2EDuration="23.841771651s" totalImagesPullingTime="20.567097303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:48.822445609 +0000 UTC m=+24.634128798" watchObservedRunningTime="2026-07-01 14:39:48.841771651 +0000 UTC m=+24.653454843" Jul 01 14:39:49.625522 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.625495 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:49.625642 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:49.625602 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:49.804129 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.804093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" event={"ID":"f0c21246-4532-4acb-8b7a-984b3401ba47","Type":"ContainerStarted","Data":"e52a4739cceef7080644d73d69e18944ea6708cf6603c53d38390b0cc40e0473"} Jul 01 14:39:49.807660 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.807605 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:39:49.808038 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.807997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"cd8fe0a40daedc125e68adb93ca65e8e31cd38954a2c5a3a20eaf98ccfa733d9"} Jul 01 14:39:49.833633 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.833579 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-172.ec2.internal" podStartSLOduration=23.833564404 podStartE2EDuration="23.833564404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:48.867090942 +0000 UTC m=+24.678774134" watchObservedRunningTime="2026-07-01 14:39:49.833564404 +0000 UTC m=+25.645247598" Jul 01 14:39:49.833869 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:49.833847 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v78kn" podStartSLOduration=10.048256312 podStartE2EDuration="24.833834349s" totalImagesPullingTime="14.785578037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:49.833162703 +0000 UTC m=+25.644845895" watchObservedRunningTime="2026-07-01 14:39:49.833834349 +0000 UTC m=+25.645517542" Jul 01 14:39:50.625989 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:50.625946 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:50.626174 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:50.626082 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:50.626174 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:50.626141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:50.626300 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:50.626280 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:51.625657 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:51.625616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:51.626024 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:51.625752 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:52.626430 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.626220 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:52.626950 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.626279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:52.626950 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:52.626554 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:52.626950 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:52.626587 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:52.815879 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.815846 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="c1db848c0013e33b66e79a4a965e807301be94ca81776b4a98af6a923ebd005a" exitCode=0 Jul 01 14:39:52.816066 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.815937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"c1db848c0013e33b66e79a4a965e807301be94ca81776b4a98af6a923ebd005a"} Jul 01 14:39:52.819607 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.819589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:39:52.819994 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.819971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"51655ca8ec8e0545e5aac6d845700149c82688566fb3e37520558f12152abeaa"} Jul 01 14:39:52.820200 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.820183 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:52.820282 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.820246 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:52.820452 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.820432 2566 scope.go:117] "RemoveContainer" containerID="1c2d4ab29be9ae9c32b127c2e3fbe169ae8c17eddd1d20b623f47f79fd550b32" Jul 01 14:39:52.836031 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:52.836013 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:53.626031 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.626003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:53.626147 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:53.626105 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:53.825243 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.825008 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="28234d71fdad5015da7360672d556e6d8f70d263e9743451e65e43a42a4f3faf" exitCode=0 Jul 01 14:39:53.825243 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.825100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"28234d71fdad5015da7360672d556e6d8f70d263e9743451e65e43a42a4f3faf"} Jul 01 14:39:53.829472 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.829450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:39:53.829918 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.829889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" event={"ID":"076fa509-880f-42cd-be0e-a75d973a1d82","Type":"ContainerStarted","Data":"8f1eb131b4dfd75a1803a26de458b4879145cf5270a608d5c794839fc4d49cab"} Jul 01 14:39:53.830187 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.830164 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:53.845101 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.845076 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:39:53.887284 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:53.887234 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" podStartSLOduration=8.239411521 podStartE2EDuration="28.887218735s" totalImagesPullingTime="20.647807214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:39:53.885819173 +0000 UTC m=+29.697502365" watchObservedRunningTime="2026-07-01 14:39:53.887218735 +0000 UTC m=+29.698901926" Jul 01 14:39:54.158780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.158748 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sll4"] Jul 01 14:39:54.158946 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.158866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:54.158982 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:54.158956 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:54.162023 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.162001 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bgqt2"] Jul 01 14:39:54.162141 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.162091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:54.162208 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:54.162169 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:54.162914 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.162889 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkm8p"] Jul 01 14:39:54.163006 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.162962 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:54.163048 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:54.163026 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:54.650652 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:54.650626 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478b1e87_9842_4629_a6cf_993cc6609979.slice/crio-73446e48b0485daef92c97494f98a8abf1d78fab3d7d733b61cd1c00289c75ca.scope\": RecentStats: unable to find data in memory cache]" Jul 01 14:39:54.834587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.834476 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="73446e48b0485daef92c97494f98a8abf1d78fab3d7d733b61cd1c00289c75ca" exitCode=0 Jul 01 14:39:54.834587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:54.834564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"73446e48b0485daef92c97494f98a8abf1d78fab3d7d733b61cd1c00289c75ca"} Jul 01 14:39:55.626598 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:55.626566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:55.626731 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:55.626609 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:55.626731 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:55.626568 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:55.626731 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:55.626682 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:55.626854 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:55.626734 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:55.626854 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:55.626826 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:57.427617 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.427577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:57.427617 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.427620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:57.428256 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.427729 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:57.428256 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.427743 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:57.428256 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.427786 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret podName:6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b nodeName:}" failed. No retries permitted until 2026-07-01 14:40:29.427770524 +0000 UTC m=+65.239453693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret") pod "global-pull-secret-syncer-hkm8p" (UID: "6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b") : object "kube-system"/"original-pull-secret" not registered Jul 01 14:39:57.428256 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.427806 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs podName:199cf7ce-2384-4654-a6c2-fbe512e4affc nodeName:}" failed. No retries permitted until 2026-07-01 14:40:29.427795344 +0000 UTC m=+65.239478513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs") pod "network-metrics-daemon-5sll4" (UID: "199cf7ce-2384-4654-a6c2-fbe512e4affc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 14:39:57.528452 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.528417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:57.528655 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.528570 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 14:39:57.528655 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.528586 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 14:39:57.528655 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.528596 2566 projected.go:196] Error preparing data for projected volume kube-api-access-pdkrm for pod openshift-network-diagnostics/network-check-target-bgqt2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:57.528655 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.528645 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm podName:506dfc42-ad2e-4482-9361-a274a9d4f770 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:29.528632043 +0000 UTC m=+65.340315211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdkrm" (UniqueName: "kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm") pod "network-check-target-bgqt2" (UID: "506dfc42-ad2e-4482-9361-a274a9d4f770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 14:39:57.625754 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.625715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:57.625934 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.625735 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:57.625934 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.625844 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkm8p" podUID="6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b" Jul 01 14:39:57.625934 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:57.625857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:57.626092 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.625938 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgqt2" podUID="506dfc42-ad2e-4482-9361-a274a9d4f770" Jul 01 14:39:57.626092 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:57.625995 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sll4" podUID="199cf7ce-2384-4654-a6c2-fbe512e4affc" Jul 01 14:39:59.495241 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.495086 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-172.ec2.internal" event="NodeReady" Jul 01 14:39:59.495674 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.495344 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 14:39:59.584966 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.584905 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8kh9n"] Jul 01 14:39:59.597858 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.597832 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2hf"] Jul 01 14:39:59.598003 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.597969 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.602756 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.602719 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 14:39:59.602874 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.602764 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 14:39:59.602942 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.602904 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs5sl\"" Jul 01 14:39:59.616689 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.616665 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2hf"] Jul 01 14:39:59.616806 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.616703 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8kh9n"] Jul 01 14:39:59.616806 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.616777 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.620001 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.619984 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wjs5n\"" Jul 01 14:39:59.620130 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.619986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 14:39:59.620217 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.620203 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 14:39:59.620217 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.620208 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 14:39:59.620527 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.620509 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 14:39:59.625799 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.625739 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:39:59.625799 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.625757 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:39:59.625955 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.625739 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:39:59.628096 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.628077 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wrx2j"] Jul 01 14:39:59.629017 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629001 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 14:39:59.629090 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629076 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 14:39:59.629300 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629287 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpckn\"" Jul 01 14:39:59.629596 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 14:39:59.629806 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629791 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 14:39:59.629881 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.629848 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9fbg\"" Jul 01 14:39:59.646365 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.646335 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrx2j"] Jul 01 14:39:59.646478 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.646444 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.650149 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.650098 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 14:39:59.650396 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.650375 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-58rmg\"" Jul 01 14:39:59.650542 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.650431 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 14:39:59.650542 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.650435 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 14:39:59.743595 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db856bb3-83c3-478e-af26-6289fc1773c7-config-volume\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.743595 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8e10c15-c5a4-4afd-aee5-df09209053da-crio-socket\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfg6f\" (UniqueName: \"kubernetes.io/projected/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-api-access-wfg6f\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72c89e91-056f-4467-aff8-54c5b7b12493-cert\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db856bb3-83c3-478e-af26-6289fc1773c7-tmp-dir\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsntx\" (UniqueName: \"kubernetes.io/projected/72c89e91-056f-4467-aff8-54c5b7b12493-kube-api-access-dsntx\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e10c15-c5a4-4afd-aee5-df09209053da-data-volume\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.743796 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9nrm\" (UniqueName: \"kubernetes.io/projected/db856bb3-83c3-478e-af26-6289fc1773c7-kube-api-access-x9nrm\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.744030 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.743823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844136 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9nrm\" (UniqueName: \"kubernetes.io/projected/db856bb3-83c3-478e-af26-6289fc1773c7-kube-api-access-x9nrm\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.844274 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844274 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db856bb3-83c3-478e-af26-6289fc1773c7-config-volume\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.844274 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.844401 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8e10c15-c5a4-4afd-aee5-df09209053da-crio-socket\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844455 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844423 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 14:39:59.844520 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844520 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8e10c15-c5a4-4afd-aee5-df09209053da-crio-socket\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844520 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:00.344465459 +0000 UTC m=+36.156148628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : secret "insights-runtime-extractor-tls" not found Jul 01 14:39:59.844520 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844423 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844525 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfg6f\" (UniqueName: \"kubernetes.io/projected/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-api-access-wfg6f\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844573 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls podName:db856bb3-83c3-478e-af26-6289fc1773c7 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:00.344548794 +0000 UTC m=+36.156231962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls") pod "dns-default-8kh9n" (UID: "db856bb3-83c3-478e-af26-6289fc1773c7") : secret "dns-default-metrics-tls" not found Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:39:59.844613 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:00.344605903 +0000 UTC m=+36.156289072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : configmap "kube-rbac-proxy" not found Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72c89e91-056f-4467-aff8-54c5b7b12493-cert\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db856bb3-83c3-478e-af26-6289fc1773c7-tmp-dir\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsntx\" (UniqueName: \"kubernetes.io/projected/72c89e91-056f-4467-aff8-54c5b7b12493-kube-api-access-dsntx\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.844728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e10c15-c5a4-4afd-aee5-df09209053da-data-volume\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.845447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.844827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db856bb3-83c3-478e-af26-6289fc1773c7-config-volume\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.845545 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.845452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db856bb3-83c3-478e-af26-6289fc1773c7-tmp-dir\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.845545 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.845452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e10c15-c5a4-4afd-aee5-df09209053da-data-volume\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.851250 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.851224 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72c89e91-056f-4467-aff8-54c5b7b12493-cert\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.852151 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.852126 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="ad140cae617686f4193e90db4bc92700ca984b6cb22d19bd5b8345534f69c693" exitCode=0 Jul 01 14:39:59.852269 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.852179 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"ad140cae617686f4193e90db4bc92700ca984b6cb22d19bd5b8345534f69c693"} Jul 01 14:39:59.865160 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.865123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfg6f\" (UniqueName: \"kubernetes.io/projected/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-api-access-wfg6f\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:39:59.865756 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.865735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9nrm\" (UniqueName: \"kubernetes.io/projected/db856bb3-83c3-478e-af26-6289fc1773c7-kube-api-access-x9nrm\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:39:59.865999 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.865981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsntx\" (UniqueName: \"kubernetes.io/projected/72c89e91-056f-4467-aff8-54c5b7b12493-kube-api-access-dsntx\") pod \"ingress-canary-wrx2j\" (UID: \"72c89e91-056f-4467-aff8-54c5b7b12493\") " pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:39:59.944167 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.944138 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g"] Jul 01 14:39:59.969123 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.969083 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g"] Jul 01 14:39:59.969273 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.969198 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" Jul 01 14:39:59.974469 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.974438 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-czrgx\"" Jul 01 14:39:59.974642 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.974471 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 14:39:59.974642 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.974536 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 14:39:59.986524 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:39:59.986502 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrx2j" Jul 01 14:40:00.147102 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.147059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957hb\" (UniqueName: \"kubernetes.io/projected/190a0fb8-eecc-42e3-bb13-5d5c420c9753-kube-api-access-957hb\") pod \"migrator-786f9fbc5-bnc6g\" (UID: \"190a0fb8-eecc-42e3-bb13-5d5c420c9753\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" Jul 01 14:40:00.182413 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.182338 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrx2j"] Jul 01 14:40:00.185997 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:00.185975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c89e91_056f_4467_aff8_54c5b7b12493.slice/crio-3341e966197c5cd16722e85fab59a8c67a36c45c4d9273d1a7915b38b3626ace WatchSource:0}: Error finding container 3341e966197c5cd16722e85fab59a8c67a36c45c4d9273d1a7915b38b3626ace: Status 404 returned error can't find the container with id 3341e966197c5cd16722e85fab59a8c67a36c45c4d9273d1a7915b38b3626ace Jul 01 14:40:00.247535 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.247477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957hb\" (UniqueName: \"kubernetes.io/projected/190a0fb8-eecc-42e3-bb13-5d5c420c9753-kube-api-access-957hb\") pod \"migrator-786f9fbc5-bnc6g\" (UID: \"190a0fb8-eecc-42e3-bb13-5d5c420c9753\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" Jul 01 14:40:00.257556 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.257524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-957hb\" (UniqueName: \"kubernetes.io/projected/190a0fb8-eecc-42e3-bb13-5d5c420c9753-kube-api-access-957hb\") pod \"migrator-786f9fbc5-bnc6g\" (UID: \"190a0fb8-eecc-42e3-bb13-5d5c420c9753\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" Jul 01 14:40:00.277827 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.277794 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" Jul 01 14:40:00.348906 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.348728 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:00.348906 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.348899 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.348958 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.348973 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:01.34895358 +0000 UTC m=+37.160636756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : secret "insights-runtime-extractor-tls" not found Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.349018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.349053 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.349096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls podName:db856bb3-83c3-478e-af26-6289fc1773c7 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:01.349084975 +0000 UTC m=+37.160768143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls") pod "dns-default-8kh9n" (UID: "db856bb3-83c3-478e-af26-6289fc1773c7") : secret "dns-default-metrics-tls" not found Jul 01 14:40:00.349120 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.349110 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 14:40:00.349356 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:00.349157 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:01.349144379 +0000 UTC m=+37.160827568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : configmap "kube-rbac-proxy" not found Jul 01 14:40:00.407895 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.407876 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g"] Jul 01 14:40:00.410746 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:00.410720 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190a0fb8_eecc_42e3_bb13_5d5c420c9753.slice/crio-9f2fcaf8c29cdfb2ec85a88fcffa73bf1be46857fe50ed6e68c3ca0cf6f5c1e6 WatchSource:0}: Error finding container 9f2fcaf8c29cdfb2ec85a88fcffa73bf1be46857fe50ed6e68c3ca0cf6f5c1e6: Status 404 returned error can't find the container with id 9f2fcaf8c29cdfb2ec85a88fcffa73bf1be46857fe50ed6e68c3ca0cf6f5c1e6 Jul 01 14:40:00.856032 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.855990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" event={"ID":"190a0fb8-eecc-42e3-bb13-5d5c420c9753","Type":"ContainerStarted","Data":"9f2fcaf8c29cdfb2ec85a88fcffa73bf1be46857fe50ed6e68c3ca0cf6f5c1e6"} Jul 01 14:40:00.859456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.859424 2566 generic.go:356] "Generic (PLEG): container finished" podID="478b1e87-9842-4629-a6cf-993cc6609979" containerID="73d0e871c2a56972bad902b1af0fa6620cb94dc86d6333509698aab107335d88" exitCode=0 Jul 01 14:40:00.859599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.859461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerDied","Data":"73d0e871c2a56972bad902b1af0fa6620cb94dc86d6333509698aab107335d88"} Jul 01 14:40:00.860867 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:00.860840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrx2j" event={"ID":"72c89e91-056f-4467-aff8-54c5b7b12493","Type":"ContainerStarted","Data":"3341e966197c5cd16722e85fab59a8c67a36c45c4d9273d1a7915b38b3626ace"} Jul 01 14:40:01.224824 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.224745 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq"] Jul 01 14:40:01.240294 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.240259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.245375 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.245349 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 14:40:01.245812 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.245568 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k9jdz\"" Jul 01 14:40:01.245812 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.245621 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq"] Jul 01 14:40:01.246203 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.245850 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 14:40:01.246203 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.246029 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 14:40:01.246298 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.246205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 14:40:01.267017 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.266992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s95lc_af32473b-d0ec-4dc2-8452-f218e629e923/dns-node-resolver/0.log" Jul 01 14:40:01.357143 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:01.357329 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:01.357329 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:01.357329 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357264 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357343 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:03.35732181 +0000 UTC m=+39.169004996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : secret "insights-runtime-extractor-tls" not found Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357346 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-key\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357346 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357423 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls podName:db856bb3-83c3-478e-af26-6289fc1773c7 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:03.357405532 +0000 UTC m=+39.169088708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls") pod "dns-default-8kh9n" (UID: "db856bb3-83c3-478e-af26-6289fc1773c7") : secret "dns-default-metrics-tls" not found Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.357481 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.357466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbpl\" (UniqueName: \"kubernetes.io/projected/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-kube-api-access-6xbpl\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.357842 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:01.357535 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:03.357506825 +0000 UTC m=+39.169190006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : configmap "kube-rbac-proxy" not found Jul 01 14:40:01.458591 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.458551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-key\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.458776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.458600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.458776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.458633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbpl\" (UniqueName: \"kubernetes.io/projected/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-kube-api-access-6xbpl\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.459645 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.459597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.463116 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.463091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-signing-key\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.470990 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.470960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbpl\" (UniqueName: \"kubernetes.io/projected/082a670c-b77e-4a36-8667-f8c0b6c0dfcf-kube-api-access-6xbpl\") pod \"service-ca-7bb4f4bcc7-jlzkq\" (UID: \"082a670c-b77e-4a36-8667-f8c0b6c0dfcf\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.553743 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.553653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" Jul 01 14:40:01.867609 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.867552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95ctp" event={"ID":"478b1e87-9842-4629-a6cf-993cc6609979","Type":"ContainerStarted","Data":"0ac825248961528d0a5f0e8c167335189c3d87843b1670dab2c3b471b34e26cf"} Jul 01 14:40:01.912691 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:01.912637 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-95ctp" podStartSLOduration=5.968944299 podStartE2EDuration="36.912621104s" totalImagesPullingTime="30.943676805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:01.912031009 +0000 UTC m=+37.723714204" watchObservedRunningTime="2026-07-01 14:40:01.912621104 +0000 UTC m=+37.724304336" Jul 01 14:40:02.222072 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:02.222002 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r868z_f71da8cc-1f71-4a7b-bc48-35d8978bec7a/node-ca/0.log" Jul 01 14:40:02.995829 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:02.995573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq"] Jul 01 14:40:02.999783 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:02.999760 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082a670c_b77e_4a36_8667_f8c0b6c0dfcf.slice/crio-fb0e77dc03b8e0dc7636c54a4bee1b4bf95c55864a8087a5917768d875fbe231 WatchSource:0}: Error finding container fb0e77dc03b8e0dc7636c54a4bee1b4bf95c55864a8087a5917768d875fbe231: Status 404 returned error can't find the container with id fb0e77dc03b8e0dc7636c54a4bee1b4bf95c55864a8087a5917768d875fbe231 Jul 01 14:40:03.373387 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.373298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:03.373387 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.373355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:03.373387 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.373380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:03.373614 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:03.373452 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 14:40:03.373614 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:03.373529 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 14:40:03.373614 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:03.373538 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:07.373523088 +0000 UTC m=+43.185206256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : secret "insights-runtime-extractor-tls" not found Jul 01 14:40:03.373614 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:03.373580 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls podName:db856bb3-83c3-478e-af26-6289fc1773c7 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:07.37356492 +0000 UTC m=+43.185248100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls") pod "dns-default-8kh9n" (UID: "db856bb3-83c3-478e-af26-6289fc1773c7") : secret "dns-default-metrics-tls" not found Jul 01 14:40:03.373932 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.373916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8e10c15-c5a4-4afd-aee5-df09209053da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:03.874107 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.873873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrx2j" event={"ID":"72c89e91-056f-4467-aff8-54c5b7b12493","Type":"ContainerStarted","Data":"5720ead2caa40f59ebba5596bacfb15f6df39b344747eaec7777d8c48eb36390"} Jul 01 14:40:03.874999 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.874975 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" event={"ID":"082a670c-b77e-4a36-8667-f8c0b6c0dfcf","Type":"ContainerStarted","Data":"fb0e77dc03b8e0dc7636c54a4bee1b4bf95c55864a8087a5917768d875fbe231"} Jul 01 14:40:03.876580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.876560 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" event={"ID":"190a0fb8-eecc-42e3-bb13-5d5c420c9753","Type":"ContainerStarted","Data":"3e8509d7ba89b0cd3bd05db179a5006e058816d4390bec6c94e2ed26411ad13b"} Jul 01 14:40:03.876684 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.876602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" event={"ID":"190a0fb8-eecc-42e3-bb13-5d5c420c9753","Type":"ContainerStarted","Data":"fe4dd01870ef33f5c06e3ebae4e13c719e785b22b3bff244aec302975a494fa1"} Jul 01 14:40:03.933043 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.932994 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bnc6g" podStartSLOduration=2.486938977 podStartE2EDuration="4.932977549s" totalImagesPullingTime="2.446038572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:03.932896879 +0000 UTC m=+39.744580071" watchObservedRunningTime="2026-07-01 14:40:03.932977549 +0000 UTC m=+39.744660740" Jul 01 14:40:03.933193 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:03.933126 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wrx2j" podStartSLOduration=2.263802469 podStartE2EDuration="4.933121943s" totalImagesPullingTime="2.669319474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:03.904678805 +0000 UTC m=+39.716361998" watchObservedRunningTime="2026-07-01 14:40:03.933121943 +0000 UTC m=+39.744805142" Jul 01 14:40:06.886803 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:06.886047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" event={"ID":"082a670c-b77e-4a36-8667-f8c0b6c0dfcf","Type":"ContainerStarted","Data":"9020cbd4b06a29e9c64e7882ca412da940f023a08c957d2c0771e4335b2d19a3"} Jul 01 14:40:06.915891 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:06.915824 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-jlzkq" podStartSLOduration=3.007743174 podStartE2EDuration="5.915803276s" totalImagesPullingTime="2.908060102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:06.913959369 +0000 UTC m=+42.725642561" watchObservedRunningTime="2026-07-01 14:40:06.915803276 +0000 UTC m=+42.727486466" Jul 01 14:40:07.404910 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:07.404869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:07.405123 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:07.404931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:07.405123 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:07.405041 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 14:40:07.405123 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:07.405096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls podName:db856bb3-83c3-478e-af26-6289fc1773c7 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:15.405082984 +0000 UTC m=+51.216766153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls") pod "dns-default-8kh9n" (UID: "db856bb3-83c3-478e-af26-6289fc1773c7") : secret "dns-default-metrics-tls" not found Jul 01 14:40:07.405292 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:07.405041 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 14:40:07.405292 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:07.405169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls podName:b8e10c15-c5a4-4afd-aee5-df09209053da nodeName:}" failed. No retries permitted until 2026-07-01 14:40:15.405155373 +0000 UTC m=+51.216838562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2hf" (UID: "b8e10c15-c5a4-4afd-aee5-df09209053da") : secret "insights-runtime-extractor-tls" not found Jul 01 14:40:15.466677 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.466642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:15.467238 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.466696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:15.470402 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.470375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db856bb3-83c3-478e-af26-6289fc1773c7-metrics-tls\") pod \"dns-default-8kh9n\" (UID: \"db856bb3-83c3-478e-af26-6289fc1773c7\") " pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:15.470526 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.470438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8e10c15-c5a4-4afd-aee5-df09209053da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2hf\" (UID: \"b8e10c15-c5a4-4afd-aee5-df09209053da\") " pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:15.550064 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.550027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:15.564311 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.564283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vh2hf" Jul 01 14:40:15.693735 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.693657 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8kh9n"] Jul 01 14:40:15.699424 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:15.699393 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb856bb3_83c3_478e_af26_6289fc1773c7.slice/crio-4a510f320a8b68ae379a78cf21dd155eb0c94577fcc37f1216c9b1f5594a704e WatchSource:0}: Error finding container 4a510f320a8b68ae379a78cf21dd155eb0c94577fcc37f1216c9b1f5594a704e: Status 404 returned error can't find the container with id 4a510f320a8b68ae379a78cf21dd155eb0c94577fcc37f1216c9b1f5594a704e Jul 01 14:40:15.716416 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.716393 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2hf"] Jul 01 14:40:15.721909 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:15.721872 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e10c15_c5a4_4afd_aee5_df09209053da.slice/crio-d02245afe90d11c0c07146f55df3b3cadbae6077506ef6ff0c0c724164256302 WatchSource:0}: Error finding container d02245afe90d11c0c07146f55df3b3cadbae6077506ef6ff0c0c724164256302: Status 404 returned error can't find the container with id d02245afe90d11c0c07146f55df3b3cadbae6077506ef6ff0c0c724164256302 Jul 01 14:40:15.911182 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.911148 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2hf" event={"ID":"b8e10c15-c5a4-4afd-aee5-df09209053da","Type":"ContainerStarted","Data":"d02245afe90d11c0c07146f55df3b3cadbae6077506ef6ff0c0c724164256302"} Jul 01 14:40:15.915662 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:15.915627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kh9n" event={"ID":"db856bb3-83c3-478e-af26-6289fc1773c7","Type":"ContainerStarted","Data":"4a510f320a8b68ae379a78cf21dd155eb0c94577fcc37f1216c9b1f5594a704e"} Jul 01 14:40:19.930071 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:19.930032 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2hf" event={"ID":"b8e10c15-c5a4-4afd-aee5-df09209053da","Type":"ContainerStarted","Data":"3ade0af1bcf9aa2f98f9d12291007306ccfcc8534001ce192ca1480e8a2964af"} Jul 01 14:40:21.937885 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:21.937849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2hf" event={"ID":"b8e10c15-c5a4-4afd-aee5-df09209053da","Type":"ContainerStarted","Data":"fc3d843aa05e0f2bb868f15e55c65da58a0e8f54cdd2bf532af844329666e6fa"} Jul 01 14:40:21.939575 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:21.939553 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kh9n" event={"ID":"db856bb3-83c3-478e-af26-6289fc1773c7","Type":"ContainerStarted","Data":"61135035d65819b467e02ee93d4c4740f8ce2ec847c5c66a7507ef82b7197a33"} Jul 01 14:40:21.939687 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:21.939591 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8kh9n" event={"ID":"db856bb3-83c3-478e-af26-6289fc1773c7","Type":"ContainerStarted","Data":"daeed6487433e90b274698b902f44ace9890348c76a52a7c8c366ee5fd0d8fcb"} Jul 01 14:40:21.939687 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:21.939675 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:21.960121 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:21.960073 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8kh9n" podStartSLOduration=17.357498248 podStartE2EDuration="22.960056527s" totalImagesPullingTime="5.602558279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:21.959089142 +0000 UTC m=+57.770772334" watchObservedRunningTime="2026-07-01 14:40:21.960056527 +0000 UTC m=+57.771739695" Jul 01 14:40:24.950579 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:24.950511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2hf" event={"ID":"b8e10c15-c5a4-4afd-aee5-df09209053da","Type":"ContainerStarted","Data":"cec2212504bb3f5c86d090a0c96f8ee02fe5781c26d2cd389381e4d7aedfb945"} Jul 01 14:40:24.984962 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:24.984906 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vh2hf" podStartSLOduration=17.935052384 podStartE2EDuration="25.984888689s" totalImagesPullingTime="8.049836305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:24.984341308 +0000 UTC m=+60.796024505" watchObservedRunningTime="2026-07-01 14:40:24.984888689 +0000 UTC m=+60.796571910" Jul 01 14:40:25.846919 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:25.846892 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj8xd" Jul 01 14:40:26.085899 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.085868 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29"] Jul 01 14:40:26.088802 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.088778 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.098588 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.098539 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 14:40:26.098678 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.098544 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 14:40:26.098678 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.098549 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 14:40:26.101879 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.101866 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c76bx\"" Jul 01 14:40:26.102685 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.102672 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 14:40:26.131270 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.131241 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv"] Jul 01 14:40:26.133888 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.133867 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29"] Jul 01 14:40:26.134014 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.133975 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.137312 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.137293 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 14:40:26.138223 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.138209 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 14:40:26.138282 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.138213 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 14:40:26.148078 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.148053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.148201 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.148086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn5kp\" (UniqueName: \"kubernetes.io/projected/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-kube-api-access-qn5kp\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.153695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.153674 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 14:40:26.190619 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.190587 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv"] Jul 01 14:40:26.249321 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.249321 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn5kp\" (UniqueName: \"kubernetes.io/projected/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-kube-api-access-qn5kp\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjkkk\" (UniqueName: \"kubernetes.io/projected/2afcacdb-65af-4a60-8e9d-3884846c0ef8-kube-api-access-kjkkk\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.249640 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.249620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2afcacdb-65af-4a60-8e9d-3884846c0ef8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.251847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.251820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.272130 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.272098 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn5kp\" (UniqueName: \"kubernetes.io/projected/449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7-kube-api-access-qn5kp\") pod \"managed-serviceaccount-addon-agent-57569866db-wzd29\" (UID: \"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.351022 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.350936 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351022 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.350968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351022 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.350988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351283 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.351116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351283 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.351152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjkkk\" (UniqueName: \"kubernetes.io/projected/2afcacdb-65af-4a60-8e9d-3884846c0ef8-kube-api-access-kjkkk\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351283 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.351190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2afcacdb-65af-4a60-8e9d-3884846c0ef8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.351851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.351829 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2afcacdb-65af-4a60-8e9d-3884846c0ef8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.353557 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.353534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.353651 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.353635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.353725 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.353708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-ca\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.353824 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.353801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2afcacdb-65af-4a60-8e9d-3884846c0ef8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.369822 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.369790 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjkkk\" (UniqueName: \"kubernetes.io/projected/2afcacdb-65af-4a60-8e9d-3884846c0ef8-kube-api-access-kjkkk\") pod \"cluster-proxy-proxy-agent-d58f9bdf8-fllgv\" (UID: \"2afcacdb-65af-4a60-8e9d-3884846c0ef8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.409405 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.409369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" Jul 01 14:40:26.444646 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.444616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" Jul 01 14:40:26.548776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.548748 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29"] Jul 01 14:40:26.552557 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:26.552527 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod449a9ff0_d6ef_4530_8b7e_7d18d7ffc4d7.slice/crio-db6bfa664ffa04372d12833e9152b8a0b3013f3aa51cf4fc765ed2d463d1c366 WatchSource:0}: Error finding container db6bfa664ffa04372d12833e9152b8a0b3013f3aa51cf4fc765ed2d463d1c366: Status 404 returned error can't find the container with id db6bfa664ffa04372d12833e9152b8a0b3013f3aa51cf4fc765ed2d463d1c366 Jul 01 14:40:26.604937 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.604785 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv"] Jul 01 14:40:26.607383 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:26.607357 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2afcacdb_65af_4a60_8e9d_3884846c0ef8.slice/crio-84fffc4889e3d71a021cc4010afbe6c1fc73b64cf236e178771eb82a9caa7cc6 WatchSource:0}: Error finding container 84fffc4889e3d71a021cc4010afbe6c1fc73b64cf236e178771eb82a9caa7cc6: Status 404 returned error can't find the container with id 84fffc4889e3d71a021cc4010afbe6c1fc73b64cf236e178771eb82a9caa7cc6 Jul 01 14:40:26.959161 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.959076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" event={"ID":"2afcacdb-65af-4a60-8e9d-3884846c0ef8","Type":"ContainerStarted","Data":"84fffc4889e3d71a021cc4010afbe6c1fc73b64cf236e178771eb82a9caa7cc6"} Jul 01 14:40:26.960053 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:26.960021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" event={"ID":"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7","Type":"ContainerStarted","Data":"db6bfa664ffa04372d12833e9152b8a0b3013f3aa51cf4fc765ed2d463d1c366"} Jul 01 14:40:29.478211 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.478175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:40:29.478699 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.478230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:40:29.483641 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.483612 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 14:40:29.484595 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.484576 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 14:40:29.491716 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.491667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b-original-pull-secret\") pod \"global-pull-secret-syncer-hkm8p\" (UID: \"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b\") " pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:40:29.491716 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.491681 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/199cf7ce-2384-4654-a6c2-fbe512e4affc-metrics-certs\") pod \"network-metrics-daemon-5sll4\" (UID: \"199cf7ce-2384-4654-a6c2-fbe512e4affc\") " pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:40:29.579190 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.579108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:40:29.582082 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.582060 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 14:40:29.593045 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.593015 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 14:40:29.603987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.603961 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdkrm\" (UniqueName: \"kubernetes.io/projected/506dfc42-ad2e-4482-9361-a274a9d4f770-kube-api-access-pdkrm\") pod \"network-check-target-bgqt2\" (UID: \"506dfc42-ad2e-4482-9361-a274a9d4f770\") " pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:40:29.670324 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.670288 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkm8p" Jul 01 14:40:29.679292 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.679262 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9fbg\"" Jul 01 14:40:29.685161 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.685134 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpckn\"" Jul 01 14:40:29.688451 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.688401 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sll4" Jul 01 14:40:29.693179 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.693157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:40:29.846393 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.846308 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkm8p"] Jul 01 14:40:29.873672 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.873641 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sll4"] Jul 01 14:40:29.895904 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.895859 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bgqt2"] Jul 01 14:40:29.972777 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.972739 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" event={"ID":"449a9ff0-d6ef-4530-8b7e-7d18d7ffc4d7","Type":"ContainerStarted","Data":"ee070efe207ec1f3821139820bdd501ad4a373738069dad2a072f9c5f3df09a8"} Jul 01 14:40:29.989112 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:29.989055 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57569866db-wzd29" podStartSLOduration=1.292228152 podStartE2EDuration="3.989036455s" totalImagesPullingTime="2.696808303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:29.988523057 +0000 UTC m=+65.800206249" watchObservedRunningTime="2026-07-01 14:40:29.989036455 +0000 UTC m=+65.800719649" Jul 01 14:40:30.918110 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:30.918080 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199cf7ce_2384_4654_a6c2_fbe512e4affc.slice/crio-74c8c8b861aae30f7d60e525c009d162dc68f311db515baf94ff0ee0f5284116 WatchSource:0}: Error finding container 74c8c8b861aae30f7d60e525c009d162dc68f311db515baf94ff0ee0f5284116: Status 404 returned error can't find the container with id 74c8c8b861aae30f7d60e525c009d162dc68f311db515baf94ff0ee0f5284116 Jul 01 14:40:30.918954 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:30.918926 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506dfc42_ad2e_4482_9361_a274a9d4f770.slice/crio-0f523cd2ad96f01734035a83f7779cefe9a49319d336db7fd9674786bf2ada34 WatchSource:0}: Error finding container 0f523cd2ad96f01734035a83f7779cefe9a49319d336db7fd9674786bf2ada34: Status 404 returned error can't find the container with id 0f523cd2ad96f01734035a83f7779cefe9a49319d336db7fd9674786bf2ada34 Jul 01 14:40:30.919957 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:30.919927 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e97e24e_fb24_43a4_b0b4_3fe4ab1efb4b.slice/crio-eb0d92010dea82af78a51e36ee3a8d8625384922cb7dae88720c76a85abe9eac WatchSource:0}: Error finding container eb0d92010dea82af78a51e36ee3a8d8625384922cb7dae88720c76a85abe9eac: Status 404 returned error can't find the container with id eb0d92010dea82af78a51e36ee3a8d8625384922cb7dae88720c76a85abe9eac Jul 01 14:40:30.977549 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:30.977519 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkm8p" event={"ID":"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b","Type":"ContainerStarted","Data":"eb0d92010dea82af78a51e36ee3a8d8625384922cb7dae88720c76a85abe9eac"} Jul 01 14:40:30.978724 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:30.978693 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sll4" event={"ID":"199cf7ce-2384-4654-a6c2-fbe512e4affc","Type":"ContainerStarted","Data":"74c8c8b861aae30f7d60e525c009d162dc68f311db515baf94ff0ee0f5284116"} Jul 01 14:40:30.979885 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:30.979864 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bgqt2" event={"ID":"506dfc42-ad2e-4482-9361-a274a9d4f770","Type":"ContainerStarted","Data":"0f523cd2ad96f01734035a83f7779cefe9a49319d336db7fd9674786bf2ada34"} Jul 01 14:40:31.944660 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:31.944625 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8kh9n" Jul 01 14:40:31.989519 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:31.989466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" event={"ID":"2afcacdb-65af-4a60-8e9d-3884846c0ef8","Type":"ContainerStarted","Data":"8bb9afb0fbd6f3e6c6aa9a4f4521bd9db37849641a9a9e167902ccb9c699da11"} Jul 01 14:40:31.989694 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:31.989536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" event={"ID":"2afcacdb-65af-4a60-8e9d-3884846c0ef8","Type":"ContainerStarted","Data":"79fb6195a2155471975c0c2fab82e713266738334f7d9a980f7ab7d05416b798"} Jul 01 14:40:31.989694 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:31.989554 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" event={"ID":"2afcacdb-65af-4a60-8e9d-3884846c0ef8","Type":"ContainerStarted","Data":"b9ac4a7d80e7e17765c4f21c562d1b34c7a3ae61139411bd3e5815558ecc38d4"} Jul 01 14:40:32.012931 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:32.012863 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d58f9bdf8-fllgv" podStartSLOduration=1.658059786 podStartE2EDuration="6.012839682s" totalImagesPullingTime="4.354779896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:32.011241505 +0000 UTC m=+67.822924709" watchObservedRunningTime="2026-07-01 14:40:32.012839682 +0000 UTC m=+67.824522874" Jul 01 14:40:36.007815 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:36.007774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bgqt2" event={"ID":"506dfc42-ad2e-4482-9361-a274a9d4f770","Type":"ContainerStarted","Data":"689e5f2c23ba1c05224c8dadb09f829853bc204844724c71aab1afdf970557c6"} Jul 01 14:40:36.008242 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:36.007890 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:40:36.009281 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:36.009223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkm8p" event={"ID":"6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b","Type":"ContainerStarted","Data":"bedb75d1bf16cb83074356e420ef9fa69f25b7491f08afc194c32b6b49e07590"} Jul 01 14:40:36.131073 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:36.131021 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hkm8p" podStartSLOduration=66.581944491 podStartE2EDuration="1m11.131004666s" totalImagesPullingTime="4.549060175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:36.130638144 +0000 UTC m=+71.942321338" watchObservedRunningTime="2026-07-01 14:40:36.131004666 +0000 UTC m=+71.942687856" Jul 01 14:40:36.131551 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:36.131292 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bgqt2" podStartSLOduration=66.585694217 podStartE2EDuration="1m11.131267368s" totalImagesPullingTime="4.545573151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:36.081641323 +0000 UTC m=+71.893324515" watchObservedRunningTime="2026-07-01 14:40:36.131267368 +0000 UTC m=+71.942950564" Jul 01 14:40:37.015061 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:37.015021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sll4" event={"ID":"199cf7ce-2384-4654-a6c2-fbe512e4affc","Type":"ContainerStarted","Data":"7ec6a8e956c2bd493148ff20ebb22d86b5b2190c0b58e6a4415da0cabeca239a"} Jul 01 14:40:37.015580 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:37.015083 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sll4" event={"ID":"199cf7ce-2384-4654-a6c2-fbe512e4affc","Type":"ContainerStarted","Data":"6c73036465078eba06688f46c75dd687f1983a4d36da8c806771c1f243cf5e06"} Jul 01 14:40:37.062949 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:37.062898 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5sll4" podStartSLOduration=66.954790696 podStartE2EDuration="1m12.062880538s" totalImagesPullingTime="5.108089842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:37.06270415 +0000 UTC m=+72.874387344" watchObservedRunningTime="2026-07-01 14:40:37.062880538 +0000 UTC m=+72.874563729" Jul 01 14:40:41.307289 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.307255 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x4mvw"] Jul 01 14:40:41.310853 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.310823 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.315302 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.315178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 14:40:41.318644 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.318619 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 14:40:41.319568 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.319161 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 14:40:41.319568 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.319438 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 14:40:41.319689 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.319647 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 14:40:41.320437 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.320416 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tpkpl\"" Jul 01 14:40:41.320647 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.320462 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 14:40:41.462075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkq4k\" (UniqueName: \"kubernetes.io/projected/e6321d32-4ed0-4744-8903-19c314386816-kube-api-access-mkq4k\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462331 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-textfile\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462331 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462331 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-wtmp\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462331 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462331 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-metrics-client-ca\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-root\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.462599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.462377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-sys\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.563767 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-metrics-client-ca\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.563767 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-root\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.563767 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-sys\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.563767 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkq4k\" (UniqueName: \"kubernetes.io/projected/e6321d32-4ed0-4744-8903-19c314386816-kube-api-access-mkq4k\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-textfile\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-root\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-sys\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-wtmp\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:41.563925 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.563929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564098 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:40:41.563988 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls podName:e6321d32-4ed0-4744-8903-19c314386816 nodeName:}" failed. No retries permitted until 2026-07-01 14:40:42.063964226 +0000 UTC m=+77.875647397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls") pod "node-exporter-x4mvw" (UID: "e6321d32-4ed0-4744-8903-19c314386816") : secret "node-exporter-tls" not found Jul 01 14:40:41.564526 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.564172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-wtmp\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564526 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.564184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-textfile\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564526 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.564460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.564628 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.564588 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6321d32-4ed0-4744-8903-19c314386816-metrics-client-ca\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.566213 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.566195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:41.584411 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:41.584385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkq4k\" (UniqueName: \"kubernetes.io/projected/e6321d32-4ed0-4744-8903-19c314386816-kube-api-access-mkq4k\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:42.068203 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:42.068168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:42.070423 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:42.070397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6321d32-4ed0-4744-8903-19c314386816-node-exporter-tls\") pod \"node-exporter-x4mvw\" (UID: \"e6321d32-4ed0-4744-8903-19c314386816\") " pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:42.221899 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:42.221862 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4mvw" Jul 01 14:40:43.036732 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:43.036697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4mvw" event={"ID":"e6321d32-4ed0-4744-8903-19c314386816","Type":"ContainerStarted","Data":"cfeb8c8824f04de2639e37b418684f4a20a2e8af1a4c40015269de1c5c7f673d"} Jul 01 14:40:46.053190 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:46.053079 2566 generic.go:356] "Generic (PLEG): container finished" podID="e6321d32-4ed0-4744-8903-19c314386816" containerID="ceacc0697a2528735fccd331500a118e5a7e258d94eac43889a06765ffb75e73" exitCode=0 Jul 01 14:40:46.053190 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:46.053140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4mvw" event={"ID":"e6321d32-4ed0-4744-8903-19c314386816","Type":"ContainerDied","Data":"ceacc0697a2528735fccd331500a118e5a7e258d94eac43889a06765ffb75e73"} Jul 01 14:40:47.058566 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.058530 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4mvw" event={"ID":"e6321d32-4ed0-4744-8903-19c314386816","Type":"ContainerStarted","Data":"aa0d006cf6ee1c19fd5e8dc1136ed37da448f53eac86d5aab9e1f1e686b4e1f4"} Jul 01 14:40:47.059035 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.058587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4mvw" event={"ID":"e6321d32-4ed0-4744-8903-19c314386816","Type":"ContainerStarted","Data":"b2ccc93ae028b9cdb3f0a3aa3f636dc9bf9471cfb1db0de1f79383a77549b7d4"} Jul 01 14:40:47.091964 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.091915 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x4mvw" podStartSLOduration=2.675729437 podStartE2EDuration="6.091900856s" totalImagesPullingTime="3.351266986s" totalInitContainerRuntime="64.904433ms" isStatefulPod=true podCreationTimestamp="2026-07-01 14:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:47.089245081 +0000 UTC m=+82.900928272" watchObservedRunningTime="2026-07-01 14:40:47.091900856 +0000 UTC m=+82.903584045" Jul 01 14:40:47.678435 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.678402 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:40:47.682781 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.682761 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.689948 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.689928 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 14:40:47.690963 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.690947 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 14:40:47.691083 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.690971 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 14:40:47.691083 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.691041 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 14:40:47.694013 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.693993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 14:40:47.694432 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694417 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 14:40:47.694473 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 14:40:47.694705 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694684 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 14:40:47.694805 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694686 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 14:40:47.694805 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694721 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 14:40:47.694805 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.694722 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 14:40:47.695335 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.695318 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 14:40:47.695402 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.695320 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fp2px\"" Jul 01 14:40:47.699694 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.699680 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fccg91oj4r1ag\"" Jul 01 14:40:47.699764 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.699751 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 14:40:47.700705 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.700690 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 14:40:47.702563 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.702544 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 14:40:47.715524 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.715480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:40:47.814258 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814258 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814482 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814723 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.814847 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.814736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tn7\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915561 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915518 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915561 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tn7\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.915750 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.915973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916706 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916706 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.916706 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.917179 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.916928 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.917179 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.917120 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.917716 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.917444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919156 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919285 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919393 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919370 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919553 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919532 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919726 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.919935 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.919911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.920530 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.920046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.920530 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.920285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.920530 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.920473 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.920733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.920610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.921262 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.921225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.921373 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.921356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.921926 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.921907 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.921926 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.921922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.922432 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.922408 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.924901 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.924879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tn7\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7\") pod \"prometheus-k8s-0\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:47.992280 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:47.992180 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:40:48.134819 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:48.134795 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:40:48.136053 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:40:48.136027 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0563f5_ee73_4e4b_a2cd_695209a1f50c.slice/crio-3df9945279a302c7627669e230cf3f097cebc83c0147dcf9af6b9fa673e52a26 WatchSource:0}: Error finding container 3df9945279a302c7627669e230cf3f097cebc83c0147dcf9af6b9fa673e52a26: Status 404 returned error can't find the container with id 3df9945279a302c7627669e230cf3f097cebc83c0147dcf9af6b9fa673e52a26 Jul 01 14:40:49.072652 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:49.072608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"3df9945279a302c7627669e230cf3f097cebc83c0147dcf9af6b9fa673e52a26"} Jul 01 14:40:50.077761 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:50.077726 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" exitCode=0 Jul 01 14:40:50.078229 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:50.077814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} Jul 01 14:40:54.095424 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:54.095386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} Jul 01 14:40:54.095841 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:54.095453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} Jul 01 14:40:57.109037 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:57.109004 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} Jul 01 14:40:57.109404 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:57.109070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} Jul 01 14:40:57.109404 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:57.109097 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} Jul 01 14:40:57.109404 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:57.109119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerStarted","Data":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} Jul 01 14:40:57.992541 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:40:57.992478 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:41:07.017730 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:41:07.017696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bgqt2" Jul 01 14:41:07.034150 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:41:07.034095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.526857818 podStartE2EDuration="20.034075728s" totalImagesPullingTime="7.493016321s" totalInitContainerRuntime="14.201589ms" isStatefulPod=false podCreationTimestamp="2026-07-01 14:40:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:40:57.173543714 +0000 UTC m=+92.985226906" watchObservedRunningTime="2026-07-01 14:41:07.034075728 +0000 UTC m=+102.845758920" Jul 01 14:41:47.993223 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:41:47.993182 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:41:48.012560 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:41:48.012532 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:41:48.303337 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:41:48.303261 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.058775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.058740 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:06.059246 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059079 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="prometheus" containerID="cri-o://0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" gracePeriod=600 Jul 01 14:42:06.059246 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059102 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy" containerID="cri-o://ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" gracePeriod=600 Jul 01 14:42:06.059246 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059148 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" gracePeriod=600 Jul 01 14:42:06.059246 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059108 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="thanos-sidecar" containerID="cri-o://65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" gracePeriod=600 Jul 01 14:42:06.059246 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059170 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-web" containerID="cri-o://d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" gracePeriod=600 Jul 01 14:42:06.059564 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.059117 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="config-reloader" containerID="cri-o://265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" gracePeriod=600 Jul 01 14:42:06.292962 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.292937 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.356447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356418 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" exitCode=0 Jul 01 14:42:06.356447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356441 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" exitCode=0 Jul 01 14:42:06.356447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356447 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" exitCode=0 Jul 01 14:42:06.356447 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356453 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" exitCode=0 Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356462 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" exitCode=0 Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356470 2566 generic.go:356] "Generic (PLEG): container finished" podID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" exitCode=0 Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356508 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356684 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.356734 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} Jul 01 14:42:06.357029 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356740 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} Jul 01 14:42:06.357029 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} Jul 01 14:42:06.357029 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.356826 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af0563f5-ee73-4e4b-a2cd-695209a1f50c","Type":"ContainerDied","Data":"3df9945279a302c7627669e230cf3f097cebc83c0147dcf9af6b9fa673e52a26"} Jul 01 14:42:06.364726 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.364705 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.371243 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.371207 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.377528 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.377508 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.383598 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.383580 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.389690 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.389673 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.396009 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.395994 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.403108 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.403041 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.403810 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.403786 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.403898 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.403816 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.403898 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.403849 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.404109 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.404095 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.404150 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404113 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.404150 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404127 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.404383 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.404356 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.404439 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404391 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.404439 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404411 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.404777 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.404761 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.404836 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404780 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.404836 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.404793 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.405035 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.405017 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.405074 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405040 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.405074 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405056 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.405334 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.405316 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.405399 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405341 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.405399 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405361 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.405604 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:42:06.405588 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.405669 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405611 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.405669 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405628 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.405836 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405819 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.405898 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.405837 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.406070 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406053 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.406127 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406071 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.406280 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406263 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.406358 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406280 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.406515 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406497 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.406567 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406516 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.406720 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406704 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.406762 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406720 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.406931 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406915 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.406995 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.406933 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.407126 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407110 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.407172 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407126 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.407314 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407296 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.407372 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407315 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.407579 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407562 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.407632 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407580 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.407801 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407782 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.407801 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407800 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.408006 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.407989 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.408061 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408006 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.408218 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408203 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.408271 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408218 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.408393 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408375 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.408462 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408393 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.408605 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408591 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.408655 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408604 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.408775 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408757 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.408817 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408775 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.408934 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408918 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.408972 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.408934 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.409108 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409093 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.409148 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409108 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.409276 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409261 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.409317 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409276 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.409467 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409451 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.409523 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409467 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.409686 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409670 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.409737 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409687 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.409919 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409894 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.409973 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.409922 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.410152 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410134 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.410197 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410152 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.410333 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410313 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.410333 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410333 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.410587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410569 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.410587 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410587 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.410778 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410764 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.410819 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410777 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.411007 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.410989 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.411049 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411008 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.411206 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411185 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.411206 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411205 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.411383 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411367 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.411423 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411384 2566 scope.go:117] "RemoveContainer" containerID="2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5" Jul 01 14:42:06.411611 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411592 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5"} err="failed to get container status \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": rpc error: code = NotFound desc = could not find container \"2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5\": container with ID starting with 2d60499bb5ca0991a58083a307e02c45b774c0ab140aba605161b58e182035a5 not found: ID does not exist" Jul 01 14:42:06.411692 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411612 2566 scope.go:117] "RemoveContainer" containerID="ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e" Jul 01 14:42:06.411824 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411806 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e"} err="failed to get container status \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": rpc error: code = NotFound desc = could not find container \"ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e\": container with ID starting with ffb614f60c7757cae948f37b723a6f6d4bd7c4d614f3a3b35b5440e309d2ab8e not found: ID does not exist" Jul 01 14:42:06.411876 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.411824 2566 scope.go:117] "RemoveContainer" containerID="d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0" Jul 01 14:42:06.412030 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412017 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0"} err="failed to get container status \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": rpc error: code = NotFound desc = could not find container \"d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0\": container with ID starting with d5e36895bc74197fbaeff1bc386ed3466955ff75b2c60002a4b47166ebb342c0 not found: ID does not exist" Jul 01 14:42:06.412085 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412030 2566 scope.go:117] "RemoveContainer" containerID="65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3" Jul 01 14:42:06.412239 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412221 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3"} err="failed to get container status \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": rpc error: code = NotFound desc = could not find container \"65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3\": container with ID starting with 65159931dcc082bee46099fd645ede5bb0c552efdb4e69b50193ad39b8c686c3 not found: ID does not exist" Jul 01 14:42:06.412292 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412240 2566 scope.go:117] "RemoveContainer" containerID="265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450" Jul 01 14:42:06.412453 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412436 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450"} err="failed to get container status \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": rpc error: code = NotFound desc = could not find container \"265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450\": container with ID starting with 265def11ccaea5e501652c68549ad9d57d2655ceae13442508e1b0bbb8e85450 not found: ID does not exist" Jul 01 14:42:06.412525 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412453 2566 scope.go:117] "RemoveContainer" containerID="0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672" Jul 01 14:42:06.412687 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412671 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672"} err="failed to get container status \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": rpc error: code = NotFound desc = could not find container \"0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672\": container with ID starting with 0c866fcd76a8a31b9dd3f944f402b31d0fa5d98ce554d0ca40dc59a5b6ebc672 not found: ID does not exist" Jul 01 14:42:06.412724 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412687 2566 scope.go:117] "RemoveContainer" containerID="7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518" Jul 01 14:42:06.412902 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.412885 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518"} err="failed to get container status \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": rpc error: code = NotFound desc = could not find container \"7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518\": container with ID starting with 7e1a4affbc5f919d0f191d4da4f9b17d6eaa78e75c1ffd663ff1dc0e0b98b518 not found: ID does not exist" Jul 01 14:42:06.426180 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426159 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426281 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426200 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426281 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426225 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426281 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426252 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426281 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426273 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426446 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426300 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426446 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426338 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426446 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426366 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426446 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426396 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426446 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426422 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426449 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7tn7\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426472 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426518 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426552 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426581 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426605 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426642 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426678 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.426695 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426675 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.427111 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426705 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.427111 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426738 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy\") pod \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\" (UID: \"af0563f5-ee73-4e4b-a2cd-695209a1f50c\") " Jul 01 14:42:06.427111 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426953 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.427111 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.426973 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.427111 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.427032 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.428592 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.427757 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.428592 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.427769 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.428592 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.427770 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 14:42:06.428592 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.428288 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.429410 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.429381 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.429523 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.429461 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.429579 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.429567 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.429967 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.429928 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:42:06.430229 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.430110 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7" (OuterVolumeSpecName: "kube-api-access-h7tn7") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "kube-api-access-h7tn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 14:42:06.430229 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.430174 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config" (OuterVolumeSpecName: "config") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.430229 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.430193 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.430229 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.430217 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.430479 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.430421 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.431238 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.431210 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 14:42:06.431515 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.431470 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.431629 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.431608 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out" (OuterVolumeSpecName: "config-out") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 14:42:06.440370 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.440341 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config" (OuterVolumeSpecName: "web-config") pod "af0563f5-ee73-4e4b-a2cd-695209a1f50c" (UID: "af0563f5-ee73-4e4b-a2cd-695209a1f50c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:42:06.527979 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.527932 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.527979 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.527969 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.527979 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.527981 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-db\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.527979 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.527990 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-grpc-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.527999 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-metrics-client-certs\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528007 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528016 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528024 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528033 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528050 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7tn7\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-kube-api-access-h7tn7\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528057 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af0563f5-ee73-4e4b-a2cd-695209a1f50c-tls-assets\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528065 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af0563f5-ee73-4e4b-a2cd-695209a1f50c-config-out\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528074 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-web-config\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528081 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528089 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528098 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-metrics-client-ca\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528105 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0563f5-ee73-4e4b-a2cd-695209a1f50c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528114 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.528249 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.528124 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af0563f5-ee73-4e4b-a2cd-695209a1f50c-secret-kube-rbac-proxy\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:42:06.678807 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.678775 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:06.685690 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.685662 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:06.719428 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719401 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:06.719722 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719706 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="prometheus" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719725 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="prometheus" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719733 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="thanos-sidecar" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719739 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="thanos-sidecar" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719746 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="config-reloader" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719751 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="config-reloader" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719756 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy" Jul 01 14:42:06.719771 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719760 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719775 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="init-config-reloader" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719780 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="init-config-reloader" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719793 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-web" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719801 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-web" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719806 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-thanos" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719811 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-thanos" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719849 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-thanos" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719855 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="prometheus" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719862 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="thanos-sidecar" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719870 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="config-reloader" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719879 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy-web" Jul 01 14:42:06.719960 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.719885 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" containerName="kube-rbac-proxy" Jul 01 14:42:06.723142 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.723128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.725941 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.725923 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 14:42:06.726456 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726433 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 14:42:06.726607 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726497 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 14:42:06.726607 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726553 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 14:42:06.726607 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 14:42:06.726797 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726787 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 14:42:06.726858 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726800 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 14:42:06.726858 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726831 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fp2px\"" Jul 01 14:42:06.726858 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726837 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 14:42:06.726858 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 14:42:06.727127 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fccg91oj4r1ag\"" Jul 01 14:42:06.727127 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.726984 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 14:42:06.727248 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.727239 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 14:42:06.727302 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.727266 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 14:42:06.727302 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.727281 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 14:42:06.731666 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.731648 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 14:42:06.733360 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.733343 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 14:42:06.749353 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.749329 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:06.829402 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829653 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829653 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829653 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829653 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829843 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829843 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829843 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829843 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829843 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68rmz\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-kube-api-access-68rmz\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.829987 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.829972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.830154 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.830004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.830154 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.830021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.830154 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.830035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.830154 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.830064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.830154 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.830079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931355 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931355 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931355 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931355 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931367 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931599 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68rmz\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-kube-api-access-68rmz\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931756 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.931780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932191 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932191 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932191 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932191 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.931927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932191 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.932170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.932415 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.932291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.933149 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.932839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.933149 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.932868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.933381 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.933331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.934387 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.934361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.934498 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.934391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.934780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.934634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.934780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.934658 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.934780 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.934666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.935371 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.935346 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.935546 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.935525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.935890 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.935868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.936873 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.936854 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.937008 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.936991 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.937129 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.937111 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.937200 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.937187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-config\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.937363 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.937349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:06.944427 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:06.944409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68rmz\" (UniqueName: \"kubernetes.io/projected/db1e1e7a-1e9a-4c29-adf1-023d9b312d7b-kube-api-access-68rmz\") pod \"prometheus-k8s-0\" (UID: \"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:07.031916 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:07.031884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:42:07.177688 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:07.177652 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 14:42:07.181413 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:42:07.181357 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1e1e7a_1e9a_4c29_adf1_023d9b312d7b.slice/crio-d4b69a0812a7fb5c3cd3caa5e82892b033607eaac61876c9ad6c3b0fbc6aac9f WatchSource:0}: Error finding container d4b69a0812a7fb5c3cd3caa5e82892b033607eaac61876c9ad6c3b0fbc6aac9f: Status 404 returned error can't find the container with id d4b69a0812a7fb5c3cd3caa5e82892b033607eaac61876c9ad6c3b0fbc6aac9f Jul 01 14:42:07.361378 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:07.361346 2566 generic.go:356] "Generic (PLEG): container finished" podID="db1e1e7a-1e9a-4c29-adf1-023d9b312d7b" containerID="8d08aa868bde8af80c1f873975b538f81b5861ce29acc9c60c9eb999bd743874" exitCode=0 Jul 01 14:42:07.361571 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:07.361436 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerDied","Data":"8d08aa868bde8af80c1f873975b538f81b5861ce29acc9c60c9eb999bd743874"} Jul 01 14:42:07.361571 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:07.361541 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"d4b69a0812a7fb5c3cd3caa5e82892b033607eaac61876c9ad6c3b0fbc6aac9f"} Jul 01 14:42:08.369408 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"db82894aa14e2e333bf03252408b0d398c9a0aab57700cb71e85759adb815c71"} Jul 01 14:42:08.369851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"ad2f439177788e85929b8637f0d208003f69a2ad85e25930ccf12dfed891a8d0"} Jul 01 14:42:08.369851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"e742770d48eef6a471f717eba50161c47eeb73ce135ab5fb3adf740bc77ed56f"} Jul 01 14:42:08.369851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"55fedb9e8773ece19a083ef0609119467f519f2e13a5bf38c822ed682f569258"} Jul 01 14:42:08.369851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"683413ce72ef725462d162d7dc1ea1792b7d684a5be2bda211dc11a795c3adec"} Jul 01 14:42:08.369851 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.369563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db1e1e7a-1e9a-4c29-adf1-023d9b312d7b","Type":"ContainerStarted","Data":"2ab0620151311901d8de5c61e3402da544b66659e4b55d52cdbaff7e4271c5c8"} Jul 01 14:42:08.631183 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:08.631103 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0563f5-ee73-4e4b-a2cd-695209a1f50c" path="/var/lib/kubelet/pods/af0563f5-ee73-4e4b-a2cd-695209a1f50c/volumes" Jul 01 14:42:12.032471 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:42:12.032429 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:43:07.032346 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:43:07.032307 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:43:07.047545 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:43:07.047516 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:43:07.084214 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:43:07.084162 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=61.065577495 podStartE2EDuration="1m1.08414665s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.569155ms" isStatefulPod=false podCreationTimestamp="2026-07-01 14:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:42:08.417389252 +0000 UTC m=+164.229072441" watchObservedRunningTime="2026-07-01 14:43:07.08414665 +0000 UTC m=+222.895829840" Jul 01 14:43:07.585519 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:43:07.585476 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 14:44:24.558049 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:44:24.558023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:44:24.562075 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:44:24.562049 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 14:44:24.566059 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:44:24.566039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:49:24.580679 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:49:24.580648 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:49:24.585524 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:49:24.585505 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:50:34.635428 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.635393 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:50:34.638220 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.638201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.640808 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.640782 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-680c6-serving-cert\"" Jul 01 14:50:34.640911 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.640822 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 14:50:34.640911 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.640875 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9cpsj\"" Jul 01 14:50:34.641852 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.641836 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-680c6-kube-rbac-proxy-sar-config\"" Jul 01 14:50:34.647033 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.646628 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:50:34.798081 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.798051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.798261 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.798091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.899507 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.899386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.899507 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.899434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.900034 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.900014 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.901923 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.901893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls\") pod \"switch-graph-680c6-bd8865647-tqtbt\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:34.951623 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:34.951597 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:35.075594 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:35.075564 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:50:35.078530 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:50:35.078501 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbdf5f0_44e0_4fbb_8d97_f092861dfd5f.slice/crio-085637bc7cb2237bda12d28c69180aadb54de7cf4b412d898d338ab395b8bb76 WatchSource:0}: Error finding container 085637bc7cb2237bda12d28c69180aadb54de7cf4b412d898d338ab395b8bb76: Status 404 returned error can't find the container with id 085637bc7cb2237bda12d28c69180aadb54de7cf4b412d898d338ab395b8bb76 Jul 01 14:50:35.080306 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:35.080289 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 14:50:36.050723 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:36.050692 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" event={"ID":"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f","Type":"ContainerStarted","Data":"085637bc7cb2237bda12d28c69180aadb54de7cf4b412d898d338ab395b8bb76"} Jul 01 14:50:38.059924 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:38.059893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" event={"ID":"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f","Type":"ContainerStarted","Data":"50e4a5dbd8592050ba73c3d4b83664cde2a98af032a0cd51f9a91b8f64d2350a"} Jul 01 14:50:38.060305 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:38.060004 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:38.077297 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:38.077242 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podStartSLOduration=1.71145715 podStartE2EDuration="4.077225857s" totalImagesPullingTime="2.365768707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:50:38.076055611 +0000 UTC m=+673.887738804" watchObservedRunningTime="2026-07-01 14:50:38.077225857 +0000 UTC m=+673.888909048" Jul 01 14:50:44.069210 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:44.069180 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:50:44.752854 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:44.752821 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:50:44.753055 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:44.753030 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" containerID="cri-o://50e4a5dbd8592050ba73c3d4b83664cde2a98af032a0cd51f9a91b8f64d2350a" gracePeriod=30 Jul 01 14:50:49.067877 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:49.067830 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:50:54.067953 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:54.067908 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:50:59.067566 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:59.067520 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:50:59.068085 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:50:59.067623 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:51:04.068222 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:04.068179 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:09.068200 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:09.068161 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:14.067939 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:14.067900 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:15.187320 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.187283 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerID="50e4a5dbd8592050ba73c3d4b83664cde2a98af032a0cd51f9a91b8f64d2350a" exitCode=0 Jul 01 14:51:15.187716 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.187339 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" event={"ID":"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f","Type":"ContainerDied","Data":"50e4a5dbd8592050ba73c3d4b83664cde2a98af032a0cd51f9a91b8f64d2350a"} Jul 01 14:51:15.404789 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.404765 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:51:15.495138 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.495043 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle\") pod \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " Jul 01 14:51:15.495138 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.495093 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls\") pod \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\" (UID: \"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f\") " Jul 01 14:51:15.495426 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.495401 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" (UID: "ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:51:15.497192 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.497174 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" (UID: "ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:51:15.596539 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.596509 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:51:15.596539 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:15.596536 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:51:16.192351 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.192270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" event={"ID":"ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f","Type":"ContainerDied","Data":"085637bc7cb2237bda12d28c69180aadb54de7cf4b412d898d338ab395b8bb76"} Jul 01 14:51:16.192351 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.192308 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt" Jul 01 14:51:16.192816 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.192361 2566 scope.go:117] "RemoveContainer" containerID="50e4a5dbd8592050ba73c3d4b83664cde2a98af032a0cd51f9a91b8f64d2350a" Jul 01 14:51:16.215641 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.215614 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:51:16.217555 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.217534 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-680c6-bd8865647-tqtbt"] Jul 01 14:51:16.630728 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:16.630694 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" path="/var/lib/kubelet/pods/ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f/volumes" Jul 01 14:51:24.677687 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.677659 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:51:24.678028 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.677980 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" Jul 01 14:51:24.678028 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.677994 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" Jul 01 14:51:24.678096 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.678071 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffbdf5f0-44e0-4fbb-8d97-f092861dfd5f" containerName="switch-graph-680c6" Jul 01 14:51:24.682026 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.682008 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:24.684783 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.684759 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\"" Jul 01 14:51:24.684923 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.684789 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 14:51:24.684923 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.684809 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9cpsj\"" Jul 01 14:51:24.685622 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.685599 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Jul 01 14:51:24.690094 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.690074 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:51:24.765459 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.765427 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:24.765646 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.765516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:24.866761 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.866672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:24.866761 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.866729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:24.866948 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:51:24.866821 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found Jul 01 14:51:24.866948 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:51:24.866874 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls podName:248317d8-01af-4a91-9c1b-70f41357f909 nodeName:}" failed. No retries permitted until 2026-07-01 14:51:25.366858489 +0000 UTC m=+721.178541659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls") pod "model-chainer-6cb794ddd7-wwfvm" (UID: "248317d8-01af-4a91-9c1b-70f41357f909") : secret "model-chainer-serving-cert" not found Jul 01 14:51:24.867441 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:24.867419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:25.370810 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:25.370778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:25.373128 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:25.373093 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") pod \"model-chainer-6cb794ddd7-wwfvm\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:25.591785 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:25.591760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:25.715505 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:25.715461 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:51:25.719435 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:51:25.719404 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248317d8_01af_4a91_9c1b_70f41357f909.slice/crio-2bc0f7ce4a95b6f89599a0ed0fce86441d4ae46ad2caebf59e0f1f86ac2c19c1 WatchSource:0}: Error finding container 2bc0f7ce4a95b6f89599a0ed0fce86441d4ae46ad2caebf59e0f1f86ac2c19c1: Status 404 returned error can't find the container with id 2bc0f7ce4a95b6f89599a0ed0fce86441d4ae46ad2caebf59e0f1f86ac2c19c1 Jul 01 14:51:26.227562 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:26.227529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" event={"ID":"248317d8-01af-4a91-9c1b-70f41357f909","Type":"ContainerStarted","Data":"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20"} Jul 01 14:51:26.227719 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:26.227580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" event={"ID":"248317d8-01af-4a91-9c1b-70f41357f909","Type":"ContainerStarted","Data":"2bc0f7ce4a95b6f89599a0ed0fce86441d4ae46ad2caebf59e0f1f86ac2c19c1"} Jul 01 14:51:26.227719 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:26.227660 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:26.246455 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:26.246408 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podStartSLOduration=2.246391379 podStartE2EDuration="2.246391379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:51:26.245442939 +0000 UTC m=+722.057126144" watchObservedRunningTime="2026-07-01 14:51:26.246391379 +0000 UTC m=+722.058074570" Jul 01 14:51:32.235586 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:32.235557 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:34.774186 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:34.774151 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:51:34.774621 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:34.774333 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" containerID="cri-o://2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20" gracePeriod=30 Jul 01 14:51:37.235107 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:37.235065 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:42.234210 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:42.234166 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:44.990052 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:44.990018 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 14:51:44.993212 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:44.993195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:44.995786 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:44.995760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3297d-serving-cert\"" Jul 01 14:51:44.995903 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:44.995773 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3297d-kube-rbac-proxy-sar-config\"" Jul 01 14:51:45.002178 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.002142 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 14:51:45.126047 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.126009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.126047 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.126057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.226894 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.226854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.227089 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:51:45.227033 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-3297d-serving-cert: secret "switch-graph-3297d-serving-cert" not found Jul 01 14:51:45.227156 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:51:45.227123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls podName:41178cfc-8fa5-4573-8d03-55fc29266f0a nodeName:}" failed. No retries permitted until 2026-07-01 14:51:45.72710009 +0000 UTC m=+741.538783264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls") pod "switch-graph-3297d-b7f46cb6-kp7sg" (UID: "41178cfc-8fa5-4573-8d03-55fc29266f0a") : secret "switch-graph-3297d-serving-cert" not found Jul 01 14:51:45.227156 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.227037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.227612 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.227595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.731385 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.731345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.733789 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.733762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") pod \"switch-graph-3297d-b7f46cb6-kp7sg\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:45.903682 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:45.903650 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:46.032180 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:46.032038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 14:51:46.034634 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:51:46.034605 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41178cfc_8fa5_4573_8d03_55fc29266f0a.slice/crio-19f43dd20f68a209094100f41834ece3f907e67014288f25d0560219f15c2c77 WatchSource:0}: Error finding container 19f43dd20f68a209094100f41834ece3f907e67014288f25d0560219f15c2c77: Status 404 returned error can't find the container with id 19f43dd20f68a209094100f41834ece3f907e67014288f25d0560219f15c2c77 Jul 01 14:51:46.295094 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:46.295005 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" event={"ID":"41178cfc-8fa5-4573-8d03-55fc29266f0a","Type":"ContainerStarted","Data":"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409"} Jul 01 14:51:46.295094 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:46.295052 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" event={"ID":"41178cfc-8fa5-4573-8d03-55fc29266f0a","Type":"ContainerStarted","Data":"19f43dd20f68a209094100f41834ece3f907e67014288f25d0560219f15c2c77"} Jul 01 14:51:46.295273 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:46.295105 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:46.314822 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:46.314778 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podStartSLOduration=2.314765388 podStartE2EDuration="2.314765388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:51:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:51:46.313400374 +0000 UTC m=+742.125083568" watchObservedRunningTime="2026-07-01 14:51:46.314765388 +0000 UTC m=+742.126448612" Jul 01 14:51:47.234638 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:47.234602 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:47.235037 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:47.234699 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:51:52.234776 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:52.234739 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:51:52.304045 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:52.304016 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 14:51:57.234350 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:51:57.234313 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:52:02.234545 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:02.234507 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 14:52:04.912703 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:04.912679 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:52:05.081947 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.081853 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") pod \"248317d8-01af-4a91-9c1b-70f41357f909\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " Jul 01 14:52:05.081947 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.081887 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle\") pod \"248317d8-01af-4a91-9c1b-70f41357f909\" (UID: \"248317d8-01af-4a91-9c1b-70f41357f909\") " Jul 01 14:52:05.082337 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.082302 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "248317d8-01af-4a91-9c1b-70f41357f909" (UID: "248317d8-01af-4a91-9c1b-70f41357f909"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 14:52:05.083885 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.083866 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "248317d8-01af-4a91-9c1b-70f41357f909" (UID: "248317d8-01af-4a91-9c1b-70f41357f909"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 14:52:05.183257 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.183220 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/248317d8-01af-4a91-9c1b-70f41357f909-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:52:05.183257 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.183259 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/248317d8-01af-4a91-9c1b-70f41357f909-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 14:52:05.366516 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.366470 2566 generic.go:356] "Generic (PLEG): container finished" podID="248317d8-01af-4a91-9c1b-70f41357f909" containerID="2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20" exitCode=0 Jul 01 14:52:05.366699 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.366532 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" Jul 01 14:52:05.366699 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.366550 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" event={"ID":"248317d8-01af-4a91-9c1b-70f41357f909","Type":"ContainerDied","Data":"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20"} Jul 01 14:52:05.366699 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.366592 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm" event={"ID":"248317d8-01af-4a91-9c1b-70f41357f909","Type":"ContainerDied","Data":"2bc0f7ce4a95b6f89599a0ed0fce86441d4ae46ad2caebf59e0f1f86ac2c19c1"} Jul 01 14:52:05.366699 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.366612 2566 scope.go:117] "RemoveContainer" containerID="2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20" Jul 01 14:52:05.374349 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.374327 2566 scope.go:117] "RemoveContainer" containerID="2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20" Jul 01 14:52:05.374653 ip-10-0-137-172 kubenswrapper[2566]: E0701 14:52:05.374633 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20\": container with ID starting with 2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20 not found: ID does not exist" containerID="2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20" Jul 01 14:52:05.374732 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.374664 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20"} err="failed to get container status \"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20\": rpc error: code = NotFound desc = could not find container \"2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20\": container with ID starting with 2fd60371b5f07304213776dad6f6753c43a26a7d227b501270e3a5223ac36f20 not found: ID does not exist" Jul 01 14:52:05.388294 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.388273 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:52:05.391976 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:05.391955 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-6cb794ddd7-wwfvm"] Jul 01 14:52:06.631257 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:06.631225 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="248317d8-01af-4a91-9c1b-70f41357f909" path="/var/lib/kubelet/pods/248317d8-01af-4a91-9c1b-70f41357f909/volumes" Jul 01 14:52:44.967758 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.967721 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 14:52:44.968153 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.967984 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" Jul 01 14:52:44.968153 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.968006 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" Jul 01 14:52:44.968153 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.968049 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="248317d8-01af-4a91-9c1b-70f41357f909" containerName="model-chainer" Jul 01 14:52:44.971898 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.971882 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:44.975956 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.975939 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0d08f-kube-rbac-proxy-sar-config\"" Jul 01 14:52:44.976098 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.975975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0d08f-serving-cert\"" Jul 01 14:52:44.979724 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:44.979703 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 14:52:45.065507 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.065442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.065683 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.065517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.166505 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.166462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.166704 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.166588 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.167200 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.167175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.168914 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.168893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls\") pod \"sequence-graph-0d08f-7ccdc4d7bd-5tjtr\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.283228 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.283138 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.405994 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.405963 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 14:52:45.409421 ip-10-0-137-172 kubenswrapper[2566]: W0701 14:52:45.409393 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8d3f1a_f9e3_4442_84cc_88787ba0f1df.slice/crio-885e47a9a6d59e25aa58e22056b469f4a955fcdca888f180c39c6104c405df9e WatchSource:0}: Error finding container 885e47a9a6d59e25aa58e22056b469f4a955fcdca888f180c39c6104c405df9e: Status 404 returned error can't find the container with id 885e47a9a6d59e25aa58e22056b469f4a955fcdca888f180c39c6104c405df9e Jul 01 14:52:45.501748 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.501713 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" event={"ID":"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df","Type":"ContainerStarted","Data":"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d"} Jul 01 14:52:45.501933 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.501772 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" event={"ID":"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df","Type":"ContainerStarted","Data":"885e47a9a6d59e25aa58e22056b469f4a955fcdca888f180c39c6104c405df9e"} Jul 01 14:52:45.501933 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.501824 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:52:45.529053 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:45.527629 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podStartSLOduration=1.5276093560000001 podStartE2EDuration="1.527609356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 14:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 14:52:45.524350148 +0000 UTC m=+801.336033340" watchObservedRunningTime="2026-07-01 14:52:45.527609356 +0000 UTC m=+801.339292548" Jul 01 14:52:51.511156 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:52:51.511065 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 14:54:24.601733 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:54:24.601654 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:54:24.609343 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:54:24.609317 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:59:24.628394 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:59:24.628314 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:59:24.629739 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:59:24.629717 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 14:59:59.751789 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:59:59.751759 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 14:59:59.752393 ip-10-0-137-172 kubenswrapper[2566]: I0701 14:59:59.751984 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" containerID="cri-o://311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409" gracePeriod=30 Jul 01 15:00:02.302116 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:02.302076 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:07.302055 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:07.302015 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:12.302659 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:12.302613 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:12.303125 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:12.302711 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 15:00:17.302458 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:17.302364 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:22.302616 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:22.302575 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:27.302090 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:27.302047 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:00:29.890983 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:29.890962 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 15:00:29.943461 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:29.943428 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle\") pod \"41178cfc-8fa5-4573-8d03-55fc29266f0a\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " Jul 01 15:00:29.943659 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:29.943504 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") pod \"41178cfc-8fa5-4573-8d03-55fc29266f0a\" (UID: \"41178cfc-8fa5-4573-8d03-55fc29266f0a\") " Jul 01 15:00:29.943868 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:29.943841 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "41178cfc-8fa5-4573-8d03-55fc29266f0a" (UID: "41178cfc-8fa5-4573-8d03-55fc29266f0a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:00:29.945446 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:29.945430 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "41178cfc-8fa5-4573-8d03-55fc29266f0a" (UID: "41178cfc-8fa5-4573-8d03-55fc29266f0a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:00:30.044808 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.044725 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/41178cfc-8fa5-4573-8d03-55fc29266f0a-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:00:30.044808 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.044754 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41178cfc-8fa5-4573-8d03-55fc29266f0a-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:00:30.101946 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.101918 2566 generic.go:356] "Generic (PLEG): container finished" podID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerID="311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409" exitCode=0 Jul 01 15:00:30.102091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.101977 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" Jul 01 15:00:30.102091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.101984 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" event={"ID":"41178cfc-8fa5-4573-8d03-55fc29266f0a","Type":"ContainerDied","Data":"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409"} Jul 01 15:00:30.102091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.102026 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg" event={"ID":"41178cfc-8fa5-4573-8d03-55fc29266f0a","Type":"ContainerDied","Data":"19f43dd20f68a209094100f41834ece3f907e67014288f25d0560219f15c2c77"} Jul 01 15:00:30.102091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.102046 2566 scope.go:117] "RemoveContainer" containerID="311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409" Jul 01 15:00:30.109638 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.109608 2566 scope.go:117] "RemoveContainer" containerID="311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409" Jul 01 15:00:30.109889 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:00:30.109871 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409\": container with ID starting with 311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409 not found: ID does not exist" containerID="311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409" Jul 01 15:00:30.109987 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.109897 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409"} err="failed to get container status \"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409\": rpc error: code = NotFound desc = could not find container \"311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409\": container with ID starting with 311642cc1bf94683599cca8099f20a784c3ca5373c096f2f76b4f34ac2684409 not found: ID does not exist" Jul 01 15:00:30.126561 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.126537 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 15:00:30.130593 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.130574 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3297d-b7f46cb6-kp7sg"] Jul 01 15:00:30.629839 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:30.629805 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" path="/var/lib/kubelet/pods/41178cfc-8fa5-4573-8d03-55fc29266f0a/volumes" Jul 01 15:00:59.647076 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:59.647042 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 15:00:59.647598 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:00:59.647249 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" containerID="cri-o://5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d" gracePeriod=30 Jul 01 15:01:01.509752 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:01.509712 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:06.509283 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:06.509244 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:09.967852 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.967815 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:09.968205 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.968146 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" Jul 01 15:01:09.968205 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.968161 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" Jul 01 15:01:09.968274 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.968215 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="41178cfc-8fa5-4573-8d03-55fc29266f0a" containerName="switch-graph-3297d" Jul 01 15:01:09.970971 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.970956 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:09.973645 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.973625 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-7bec4-serving-cert\"" Jul 01 15:01:09.973862 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.973848 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-7bec4-kube-rbac-proxy-sar-config\"" Jul 01 15:01:09.984354 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:09.984334 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:10.019323 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.019248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.019323 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.019290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.120690 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.120644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.120690 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.120698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.120928 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:01:10.120810 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-7bec4-serving-cert: secret "ensemble-graph-7bec4-serving-cert" not found Jul 01 15:01:10.120928 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:01:10.120864 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls podName:bb489ab5-5eea-4f28-a2fc-12328da95cc0 nodeName:}" failed. No retries permitted until 2026-07-01 15:01:10.620848028 +0000 UTC m=+1306.432531198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls") pod "ensemble-graph-7bec4-7d868b65cf-hg9nb" (UID: "bb489ab5-5eea-4f28-a2fc-12328da95cc0") : secret "ensemble-graph-7bec4-serving-cert" not found Jul 01 15:01:10.121264 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.121243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.625719 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.625678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.628292 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.628266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") pod \"ensemble-graph-7bec4-7d868b65cf-hg9nb\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:10.881444 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:10.881353 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:11.007590 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.007384 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:11.010402 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:01:11.010373 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb489ab5_5eea_4f28_a2fc_12328da95cc0.slice/crio-121fb205f58f88320e028dd0c0ca1adfc04111c7fb8c60425904c9ff1ea6ce75 WatchSource:0}: Error finding container 121fb205f58f88320e028dd0c0ca1adfc04111c7fb8c60425904c9ff1ea6ce75: Status 404 returned error can't find the container with id 121fb205f58f88320e028dd0c0ca1adfc04111c7fb8c60425904c9ff1ea6ce75 Jul 01 15:01:11.247304 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.247208 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" event={"ID":"bb489ab5-5eea-4f28-a2fc-12328da95cc0","Type":"ContainerStarted","Data":"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47"} Jul 01 15:01:11.247304 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.247259 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" event={"ID":"bb489ab5-5eea-4f28-a2fc-12328da95cc0","Type":"ContainerStarted","Data":"121fb205f58f88320e028dd0c0ca1adfc04111c7fb8c60425904c9ff1ea6ce75"} Jul 01 15:01:11.247552 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.247322 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:11.266325 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.266275 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podStartSLOduration=2.266259131 podStartE2EDuration="2.266259131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:01:11.265433011 +0000 UTC m=+1307.077116203" watchObservedRunningTime="2026-07-01 15:01:11.266259131 +0000 UTC m=+1307.077942322" Jul 01 15:01:11.509352 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.509265 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:11.509517 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:11.509365 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 15:01:16.509321 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:16.509280 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:17.256900 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:17.256873 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:20.043627 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:20.043587 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:20.044081 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:20.043815 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" containerID="cri-o://be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47" gracePeriod=30 Jul 01 15:01:21.509388 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:21.509352 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:22.255336 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:22.255301 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:26.509328 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:26.509290 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:27.254950 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:27.254907 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:29.788053 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.788029 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 15:01:29.866657 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.866625 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls\") pod \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " Jul 01 15:01:29.866838 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.866676 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle\") pod \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\" (UID: \"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df\") " Jul 01 15:01:29.867079 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.867049 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" (UID: "4a8d3f1a-f9e3-4442-84cc-88787ba0f1df"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:01:29.868822 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.868802 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" (UID: "4a8d3f1a-f9e3-4442-84cc-88787ba0f1df"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:01:29.967214 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.967136 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:01:29.967214 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:29.967157 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:01:30.313110 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.313022 2566 generic.go:356] "Generic (PLEG): container finished" podID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerID="5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d" exitCode=0 Jul 01 15:01:30.313110 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.313066 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" Jul 01 15:01:30.313110 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.313078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" event={"ID":"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df","Type":"ContainerDied","Data":"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d"} Jul 01 15:01:30.313331 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.313125 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr" event={"ID":"4a8d3f1a-f9e3-4442-84cc-88787ba0f1df","Type":"ContainerDied","Data":"885e47a9a6d59e25aa58e22056b469f4a955fcdca888f180c39c6104c405df9e"} Jul 01 15:01:30.313331 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.313149 2566 scope.go:117] "RemoveContainer" containerID="5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d" Jul 01 15:01:30.321425 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.321404 2566 scope.go:117] "RemoveContainer" containerID="5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d" Jul 01 15:01:30.321696 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:01:30.321672 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d\": container with ID starting with 5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d not found: ID does not exist" containerID="5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d" Jul 01 15:01:30.321763 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.321702 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d"} err="failed to get container status \"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d\": rpc error: code = NotFound desc = could not find container \"5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d\": container with ID starting with 5156b875ed3bfca20d2361d69acad393ccd93edaf9c78e74e09c22e05988658d not found: ID does not exist" Jul 01 15:01:30.333873 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.333847 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 15:01:30.337474 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.337451 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0d08f-7ccdc4d7bd-5tjtr"] Jul 01 15:01:30.631562 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:30.631521 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" path="/var/lib/kubelet/pods/4a8d3f1a-f9e3-4442-84cc-88787ba0f1df/volumes" Jul 01 15:01:32.255820 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:32.255785 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:32.256315 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:32.255916 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:37.255086 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:37.255047 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:42.255421 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:42.255384 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:47.255775 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:47.255700 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:01:50.179215 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.179193 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:50.324805 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.324729 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle\") pod \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " Jul 01 15:01:50.324805 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.324775 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") pod \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\" (UID: \"bb489ab5-5eea-4f28-a2fc-12328da95cc0\") " Jul 01 15:01:50.325109 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.325076 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "bb489ab5-5eea-4f28-a2fc-12328da95cc0" (UID: "bb489ab5-5eea-4f28-a2fc-12328da95cc0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:01:50.326695 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.326677 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bb489ab5-5eea-4f28-a2fc-12328da95cc0" (UID: "bb489ab5-5eea-4f28-a2fc-12328da95cc0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:01:50.384378 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.384348 2566 generic.go:356] "Generic (PLEG): container finished" podID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerID="be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47" exitCode=0 Jul 01 15:01:50.384514 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.384389 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" Jul 01 15:01:50.384514 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.384393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" event={"ID":"bb489ab5-5eea-4f28-a2fc-12328da95cc0","Type":"ContainerDied","Data":"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47"} Jul 01 15:01:50.384514 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.384432 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb" event={"ID":"bb489ab5-5eea-4f28-a2fc-12328da95cc0","Type":"ContainerDied","Data":"121fb205f58f88320e028dd0c0ca1adfc04111c7fb8c60425904c9ff1ea6ce75"} Jul 01 15:01:50.384514 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.384453 2566 scope.go:117] "RemoveContainer" containerID="be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47" Jul 01 15:01:50.397875 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.397842 2566 scope.go:117] "RemoveContainer" containerID="be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47" Jul 01 15:01:50.398105 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:01:50.398089 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47\": container with ID starting with be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47 not found: ID does not exist" containerID="be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47" Jul 01 15:01:50.398155 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.398113 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47"} err="failed to get container status \"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47\": rpc error: code = NotFound desc = could not find container \"be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47\": container with ID starting with be6c0d3a0d1c6d558e663e153f1e748a0c632ec9b68442e704a8d559b7fe2d47 not found: ID does not exist" Jul 01 15:01:50.407734 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.407713 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:50.413568 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.413546 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-7bec4-7d868b65cf-hg9nb"] Jul 01 15:01:50.425876 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.425858 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb489ab5-5eea-4f28-a2fc-12328da95cc0-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:01:50.425876 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.425874 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb489ab5-5eea-4f28-a2fc-12328da95cc0-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:01:50.630065 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:01:50.630031 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" path="/var/lib/kubelet/pods/bb489ab5-5eea-4f28-a2fc-12328da95cc0/volumes" Jul 01 15:02:09.836472 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836432 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:09.836935 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836850 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" Jul 01 15:02:09.836935 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836868 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" Jul 01 15:02:09.836935 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836890 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" Jul 01 15:02:09.836935 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836898 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" Jul 01 15:02:09.837129 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836978 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a8d3f1a-f9e3-4442-84cc-88787ba0f1df" containerName="sequence-graph-0d08f" Jul 01 15:02:09.837129 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.836991 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb489ab5-5eea-4f28-a2fc-12328da95cc0" containerName="ensemble-graph-7bec4" Jul 01 15:02:09.839798 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.839778 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.843526 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.843480 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 15:02:09.843526 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.843515 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-102b8-kube-rbac-proxy-sar-config\"" Jul 01 15:02:09.843682 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.843538 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-102b8-serving-cert\"" Jul 01 15:02:09.843682 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.843611 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9cpsj\"" Jul 01 15:02:09.847440 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.847418 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:09.865528 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.865504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.865636 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.865537 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.966254 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.966227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.966377 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.966260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.966937 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.966913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:09.968522 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:09.968478 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls\") pod \"sequence-graph-102b8-558d7fd485-66cml\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:10.150441 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.150402 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:10.270837 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.270809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:10.273930 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:02:10.273906 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbe2906_c292_47aa_80d3_83a457af7721.slice/crio-034e155a86835e4e68608947cf71d2335d165b579d58ccfb397db55835d7c48f WatchSource:0}: Error finding container 034e155a86835e4e68608947cf71d2335d165b579d58ccfb397db55835d7c48f: Status 404 returned error can't find the container with id 034e155a86835e4e68608947cf71d2335d165b579d58ccfb397db55835d7c48f Jul 01 15:02:10.457508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.457411 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" event={"ID":"8fbe2906-c292-47aa-80d3-83a457af7721","Type":"ContainerStarted","Data":"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa"} Jul 01 15:02:10.457508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.457463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" event={"ID":"8fbe2906-c292-47aa-80d3-83a457af7721","Type":"ContainerStarted","Data":"034e155a86835e4e68608947cf71d2335d165b579d58ccfb397db55835d7c48f"} Jul 01 15:02:10.457694 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.457539 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:10.473822 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:10.473772 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podStartSLOduration=1.473759271 podStartE2EDuration="1.473759271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:02:10.472776188 +0000 UTC m=+1366.284459379" watchObservedRunningTime="2026-07-01 15:02:10.473759271 +0000 UTC m=+1366.285442484" Jul 01 15:02:16.466353 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:16.466317 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:19.918986 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:19.918955 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:19.919355 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:19.919189 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" containerID="cri-o://f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa" gracePeriod=30 Jul 01 15:02:20.270179 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.270086 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:02:20.272699 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.272681 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.275643 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.275614 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-9eaf2-serving-cert\"" Jul 01 15:02:20.275747 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.275649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-9eaf2-kube-rbac-proxy-sar-config\"" Jul 01 15:02:20.282609 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.282588 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:02:20.338780 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.338742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.338951 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.338785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.439672 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.439637 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.439860 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.439684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.440326 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.440302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.442203 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.442184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls\") pod \"ensemble-graph-9eaf2-f76f65bd7-dlvlw\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.583067 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.582983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:20.710513 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:20.710465 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:02:20.713657 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:02:20.713632 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0809d1a8_c26f_474f_a311_2175f16753c0.slice/crio-7b98632ca624bf80b6c4f93dd1b2cd66cead3a103cd2bd72f523e2dc945e5f4c WatchSource:0}: Error finding container 7b98632ca624bf80b6c4f93dd1b2cd66cead3a103cd2bd72f523e2dc945e5f4c: Status 404 returned error can't find the container with id 7b98632ca624bf80b6c4f93dd1b2cd66cead3a103cd2bd72f523e2dc945e5f4c Jul 01 15:02:21.466027 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:21.465988 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:21.495819 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:21.495783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" event={"ID":"0809d1a8-c26f-474f-a311-2175f16753c0","Type":"ContainerStarted","Data":"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a"} Jul 01 15:02:21.496044 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:21.495859 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" event={"ID":"0809d1a8-c26f-474f-a311-2175f16753c0","Type":"ContainerStarted","Data":"7b98632ca624bf80b6c4f93dd1b2cd66cead3a103cd2bd72f523e2dc945e5f4c"} Jul 01 15:02:21.496044 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:21.495918 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:21.514325 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:21.514271 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podStartSLOduration=1.514254575 podStartE2EDuration="1.514254575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:02:21.513247336 +0000 UTC m=+1377.324930530" watchObservedRunningTime="2026-07-01 15:02:21.514254575 +0000 UTC m=+1377.325937812" Jul 01 15:02:26.464799 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:26.464763 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:27.504319 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:27.504295 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:02:31.464977 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:31.464943 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:31.465366 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:31.465052 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:36.464804 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:36.464761 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:41.464889 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:41.464852 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:46.465502 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:46.465446 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:02:50.091710 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.091685 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:50.171207 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.171180 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle\") pod \"8fbe2906-c292-47aa-80d3-83a457af7721\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " Jul 01 15:02:50.171386 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.171236 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls\") pod \"8fbe2906-c292-47aa-80d3-83a457af7721\" (UID: \"8fbe2906-c292-47aa-80d3-83a457af7721\") " Jul 01 15:02:50.171631 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.171605 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8fbe2906-c292-47aa-80d3-83a457af7721" (UID: "8fbe2906-c292-47aa-80d3-83a457af7721"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:02:50.173289 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.173239 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8fbe2906-c292-47aa-80d3-83a457af7721" (UID: "8fbe2906-c292-47aa-80d3-83a457af7721"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:02:50.271838 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.271798 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fbe2906-c292-47aa-80d3-83a457af7721-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:02:50.271838 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.271825 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8fbe2906-c292-47aa-80d3-83a457af7721-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:02:50.596529 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.596475 2566 generic.go:356] "Generic (PLEG): container finished" podID="8fbe2906-c292-47aa-80d3-83a457af7721" containerID="f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa" exitCode=137 Jul 01 15:02:50.596529 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.596526 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" Jul 01 15:02:50.596752 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.596539 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" event={"ID":"8fbe2906-c292-47aa-80d3-83a457af7721","Type":"ContainerDied","Data":"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa"} Jul 01 15:02:50.596752 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.596581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml" event={"ID":"8fbe2906-c292-47aa-80d3-83a457af7721","Type":"ContainerDied","Data":"034e155a86835e4e68608947cf71d2335d165b579d58ccfb397db55835d7c48f"} Jul 01 15:02:50.596752 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.596602 2566 scope.go:117] "RemoveContainer" containerID="f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa" Jul 01 15:02:50.605032 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.605010 2566 scope.go:117] "RemoveContainer" containerID="f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa" Jul 01 15:02:50.605261 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:02:50.605244 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa\": container with ID starting with f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa not found: ID does not exist" containerID="f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa" Jul 01 15:02:50.605314 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.605268 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa"} err="failed to get container status \"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa\": rpc error: code = NotFound desc = could not find container \"f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa\": container with ID starting with f3183389dbd5e634dc36f7b23e1a32b5e5500d7f4590fc219abc8ad132d831fa not found: ID does not exist" Jul 01 15:02:50.617075 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.617047 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:50.621243 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.621219 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-102b8-558d7fd485-66cml"] Jul 01 15:02:50.630248 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:02:50.630222 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" path="/var/lib/kubelet/pods/8fbe2906-c292-47aa-80d3-83a457af7721/volumes" Jul 01 15:03:30.163351 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.163320 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:03:30.163923 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.163718 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" Jul 01 15:03:30.163923 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.163734 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" Jul 01 15:03:30.163923 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.163821 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fbe2906-c292-47aa-80d3-83a457af7721" containerName="sequence-graph-102b8" Jul 01 15:03:30.167895 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.167875 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.170655 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.170637 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6e167-serving-cert\"" Jul 01 15:03:30.170758 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.170655 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-6e167-kube-rbac-proxy-sar-config\"" Jul 01 15:03:30.176588 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.176565 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:03:30.259685 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.259646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.259867 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.259713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.360293 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.360256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.360457 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.360309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.360457 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:03:30.360408 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-6e167-serving-cert: secret "sequence-graph-6e167-serving-cert" not found Jul 01 15:03:30.360558 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:03:30.360480 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls podName:a153dd8c-f1b3-40a5-bf9b-74f7266cb25e nodeName:}" failed. No retries permitted until 2026-07-01 15:03:30.860462358 +0000 UTC m=+1446.672145526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls") pod "sequence-graph-6e167-56486bcfc4-cjsnq" (UID: "a153dd8c-f1b3-40a5-bf9b-74f7266cb25e") : secret "sequence-graph-6e167-serving-cert" not found Jul 01 15:03:30.360869 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.360853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.863833 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.863798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:30.866061 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:30.866039 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") pod \"sequence-graph-6e167-56486bcfc4-cjsnq\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:31.078091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.078056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:31.204014 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.203980 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:03:31.207151 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:03:31.207125 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda153dd8c_f1b3_40a5_bf9b_74f7266cb25e.slice/crio-adc42878c37a9875b2c005f85b22bdc5f01cb7f1a9bd08662331fd4cec7572aa WatchSource:0}: Error finding container adc42878c37a9875b2c005f85b22bdc5f01cb7f1a9bd08662331fd4cec7572aa: Status 404 returned error can't find the container with id adc42878c37a9875b2c005f85b22bdc5f01cb7f1a9bd08662331fd4cec7572aa Jul 01 15:03:31.739523 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.739471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" event={"ID":"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e","Type":"ContainerStarted","Data":"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc"} Jul 01 15:03:31.739705 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.739537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" event={"ID":"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e","Type":"ContainerStarted","Data":"adc42878c37a9875b2c005f85b22bdc5f01cb7f1a9bd08662331fd4cec7572aa"} Jul 01 15:03:31.739705 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.739630 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:03:31.761148 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:31.761104 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podStartSLOduration=1.7610902560000001 podStartE2EDuration="1.761090256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:03:31.760575458 +0000 UTC m=+1447.572258647" watchObservedRunningTime="2026-07-01 15:03:31.761090256 +0000 UTC m=+1447.572773445" Jul 01 15:03:37.751022 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:03:37.750995 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:04:24.652087 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:04:24.652039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:04:24.652602 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:04:24.652375 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:09:24.674160 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:09:24.674135 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:09:24.674628 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:09:24.674132 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:10:34.910091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:34.910061 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:10:34.910623 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:34.910242 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" containerID="cri-o://bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a" gracePeriod=30 Jul 01 15:10:37.502660 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:37.502623 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:10:42.503029 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:42.502985 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:10:47.502670 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:47.502588 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:10:47.503014 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:47.502688 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:10:52.503008 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:52.502964 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:10:57.502794 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:10:57.502750 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:02.502967 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:02.502935 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:05.050919 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.050897 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:11:05.192825 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.192754 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls\") pod \"0809d1a8-c26f-474f-a311-2175f16753c0\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " Jul 01 15:11:05.192825 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.192806 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle\") pod \"0809d1a8-c26f-474f-a311-2175f16753c0\" (UID: \"0809d1a8-c26f-474f-a311-2175f16753c0\") " Jul 01 15:11:05.193160 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.193138 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0809d1a8-c26f-474f-a311-2175f16753c0" (UID: "0809d1a8-c26f-474f-a311-2175f16753c0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:11:05.194750 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.194716 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0809d1a8-c26f-474f-a311-2175f16753c0" (UID: "0809d1a8-c26f-474f-a311-2175f16753c0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:11:05.293736 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.293698 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0809d1a8-c26f-474f-a311-2175f16753c0-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:11:05.293736 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.293725 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0809d1a8-c26f-474f-a311-2175f16753c0-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:11:05.302465 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.302434 2566 generic.go:356] "Generic (PLEG): container finished" podID="0809d1a8-c26f-474f-a311-2175f16753c0" containerID="bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a" exitCode=0 Jul 01 15:11:05.302610 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.302477 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" Jul 01 15:11:05.302610 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.302521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" event={"ID":"0809d1a8-c26f-474f-a311-2175f16753c0","Type":"ContainerDied","Data":"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a"} Jul 01 15:11:05.302610 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.302577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw" event={"ID":"0809d1a8-c26f-474f-a311-2175f16753c0","Type":"ContainerDied","Data":"7b98632ca624bf80b6c4f93dd1b2cd66cead3a103cd2bd72f523e2dc945e5f4c"} Jul 01 15:11:05.302610 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.302600 2566 scope.go:117] "RemoveContainer" containerID="bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a" Jul 01 15:11:05.311112 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.311096 2566 scope.go:117] "RemoveContainer" containerID="bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a" Jul 01 15:11:05.311348 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:11:05.311333 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a\": container with ID starting with bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a not found: ID does not exist" containerID="bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a" Jul 01 15:11:05.311395 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.311357 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a"} err="failed to get container status \"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a\": rpc error: code = NotFound desc = could not find container \"bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a\": container with ID starting with bb32b0a91af72ce94fc6f14b6008b6c9fc1a0d8022b86328ac3a899651a6a96a not found: ID does not exist" Jul 01 15:11:05.324125 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.324101 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:11:05.326268 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:05.326249 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-9eaf2-f76f65bd7-dlvlw"] Jul 01 15:11:06.630080 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:06.630045 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" path="/var/lib/kubelet/pods/0809d1a8-c26f-474f-a311-2175f16753c0/volumes" Jul 01 15:11:35.157931 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.157900 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:11:35.158414 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.158156 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" Jul 01 15:11:35.158414 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.158167 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" Jul 01 15:11:35.158414 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.158222 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0809d1a8-c26f-474f-a311-2175f16753c0" containerName="ensemble-graph-9eaf2" Jul 01 15:11:35.160861 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.160845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.163775 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.163752 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-6f42a-serving-cert\"" Jul 01 15:11:35.164204 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.164187 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-6f42a-kube-rbac-proxy-sar-config\"" Jul 01 15:11:35.172066 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.172044 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:11:35.313563 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.313532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.313738 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.313572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.414259 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.414192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.414259 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.414226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.414419 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:11:35.414338 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-6f42a-serving-cert: secret "splitter-graph-6f42a-serving-cert" not found Jul 01 15:11:35.414419 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:11:35.414407 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls podName:f2d452e3-5898-454d-b107-12d51ed8e570 nodeName:}" failed. No retries permitted until 2026-07-01 15:11:35.914387176 +0000 UTC m=+1931.726070359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls") pod "splitter-graph-6f42a-7bd888d8d8-dvx4g" (UID: "f2d452e3-5898-454d-b107-12d51ed8e570") : secret "splitter-graph-6f42a-serving-cert" not found Jul 01 15:11:35.414888 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.414870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.917233 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.917199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:35.919509 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:35.919472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") pod \"splitter-graph-6f42a-7bd888d8d8-dvx4g\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:36.070801 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.070768 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:36.191838 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.191768 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:11:36.194638 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:11:36.194614 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d452e3_5898_454d_b107_12d51ed8e570.slice/crio-c10f47b39c650bb4153f1bd295ed19c16ea8477c843152cdea07cda48490624b WatchSource:0}: Error finding container c10f47b39c650bb4153f1bd295ed19c16ea8477c843152cdea07cda48490624b: Status 404 returned error can't find the container with id c10f47b39c650bb4153f1bd295ed19c16ea8477c843152cdea07cda48490624b Jul 01 15:11:36.410986 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.410951 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" event={"ID":"f2d452e3-5898-454d-b107-12d51ed8e570","Type":"ContainerStarted","Data":"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679"} Jul 01 15:11:36.411139 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.411009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" event={"ID":"f2d452e3-5898-454d-b107-12d51ed8e570","Type":"ContainerStarted","Data":"c10f47b39c650bb4153f1bd295ed19c16ea8477c843152cdea07cda48490624b"} Jul 01 15:11:36.411139 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.411045 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:36.428553 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:36.428505 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podStartSLOduration=1.428478534 podStartE2EDuration="1.428478534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:11:36.427465122 +0000 UTC m=+1932.239148313" watchObservedRunningTime="2026-07-01 15:11:36.428478534 +0000 UTC m=+1932.240161724" Jul 01 15:11:42.420070 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:42.420041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:44.901695 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:44.901662 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:11:44.902068 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:44.901901 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" containerID="cri-o://671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc" gracePeriod=30 Jul 01 15:11:45.281471 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:45.281392 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:11:45.281626 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:45.281584 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" containerID="cri-o://51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679" gracePeriod=30 Jul 01 15:11:47.418451 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:47.418414 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:47.748901 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:47.748816 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:52.419066 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:52.419024 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:52.748399 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:52.748306 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:57.418721 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:57.418684 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:57.419092 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:57.418838 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:11:57.748918 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:57.748825 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:11:57.749059 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:11:57.748934 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:12:02.418467 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:02.418431 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:02.748675 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:02.748583 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:07.418504 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:07.418459 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:07.748686 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:07.748599 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:12.418765 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:12.418727 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:12.748290 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:12.748206 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:12:15.040190 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.040167 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:12:15.108242 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.108203 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") pod \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " Jul 01 15:12:15.108404 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.108278 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle\") pod \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\" (UID: \"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e\") " Jul 01 15:12:15.108654 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.108625 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" (UID: "a153dd8c-f1b3-40a5-bf9b-74f7266cb25e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:12:15.110204 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.110177 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" (UID: "a153dd8c-f1b3-40a5-bf9b-74f7266cb25e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:12:15.209147 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.209068 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:12:15.209147 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.209094 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:12:15.452194 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.452172 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:12:15.512519 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.512417 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") pod \"f2d452e3-5898-454d-b107-12d51ed8e570\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " Jul 01 15:12:15.512519 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.512463 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle\") pod \"f2d452e3-5898-454d-b107-12d51ed8e570\" (UID: \"f2d452e3-5898-454d-b107-12d51ed8e570\") " Jul 01 15:12:15.512870 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.512846 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f2d452e3-5898-454d-b107-12d51ed8e570" (UID: "f2d452e3-5898-454d-b107-12d51ed8e570"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:12:15.514465 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.514444 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f2d452e3-5898-454d-b107-12d51ed8e570" (UID: "f2d452e3-5898-454d-b107-12d51ed8e570"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:12:15.547341 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.547304 2566 generic.go:356] "Generic (PLEG): container finished" podID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerID="671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc" exitCode=0 Jul 01 15:12:15.547508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.547366 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" Jul 01 15:12:15.547508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.547372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" event={"ID":"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e","Type":"ContainerDied","Data":"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc"} Jul 01 15:12:15.547508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.547416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq" event={"ID":"a153dd8c-f1b3-40a5-bf9b-74f7266cb25e","Type":"ContainerDied","Data":"adc42878c37a9875b2c005f85b22bdc5f01cb7f1a9bd08662331fd4cec7572aa"} Jul 01 15:12:15.547508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.547443 2566 scope.go:117] "RemoveContainer" containerID="671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc" Jul 01 15:12:15.548520 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.548481 2566 generic.go:356] "Generic (PLEG): container finished" podID="f2d452e3-5898-454d-b107-12d51ed8e570" containerID="51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679" exitCode=137 Jul 01 15:12:15.548703 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.548539 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" Jul 01 15:12:15.548703 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.548570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" event={"ID":"f2d452e3-5898-454d-b107-12d51ed8e570","Type":"ContainerDied","Data":"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679"} Jul 01 15:12:15.548703 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.548602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g" event={"ID":"f2d452e3-5898-454d-b107-12d51ed8e570","Type":"ContainerDied","Data":"c10f47b39c650bb4153f1bd295ed19c16ea8477c843152cdea07cda48490624b"} Jul 01 15:12:15.556648 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.556624 2566 scope.go:117] "RemoveContainer" containerID="671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc" Jul 01 15:12:15.556979 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:12:15.556954 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc\": container with ID starting with 671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc not found: ID does not exist" containerID="671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc" Jul 01 15:12:15.557052 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.556990 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc"} err="failed to get container status \"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc\": rpc error: code = NotFound desc = could not find container \"671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc\": container with ID starting with 671846381f08ea4be082805b069956e8706e960efeb267bc8554987c541067cc not found: ID does not exist" Jul 01 15:12:15.557052 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.557008 2566 scope.go:117] "RemoveContainer" containerID="51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679" Jul 01 15:12:15.564434 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.564417 2566 scope.go:117] "RemoveContainer" containerID="51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679" Jul 01 15:12:15.564953 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:12:15.564938 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679\": container with ID starting with 51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679 not found: ID does not exist" containerID="51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679" Jul 01 15:12:15.565012 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.564960 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679"} err="failed to get container status \"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679\": rpc error: code = NotFound desc = could not find container \"51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679\": container with ID starting with 51e07bfcd2d7e044927581e52e72a1d5af025b3fca9b77398e7cab3f78dda679 not found: ID does not exist" Jul 01 15:12:15.573426 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.573405 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:12:15.578597 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.578577 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-6e167-56486bcfc4-cjsnq"] Jul 01 15:12:15.591315 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.591294 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:12:15.596642 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.596624 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6f42a-7bd888d8d8-dvx4g"] Jul 01 15:12:15.613016 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.612991 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f2d452e3-5898-454d-b107-12d51ed8e570-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:12:15.613016 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:15.613009 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d452e3-5898-454d-b107-12d51ed8e570-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:12:16.630170 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:16.630137 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" path="/var/lib/kubelet/pods/a153dd8c-f1b3-40a5-bf9b-74f7266cb25e/volumes" Jul 01 15:12:16.630561 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:16.630463 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" path="/var/lib/kubelet/pods/f2d452e3-5898-454d-b107-12d51ed8e570/volumes" Jul 01 15:12:55.126381 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126342 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126605 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126616 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126628 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126633 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126698 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a153dd8c-f1b3-40a5-bf9b-74f7266cb25e" containerName="sequence-graph-6e167" Jul 01 15:12:55.126823 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.126706 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d452e3-5898-454d-b107-12d51ed8e570" containerName="splitter-graph-6f42a" Jul 01 15:12:55.129552 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.129536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.132054 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.132025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f5851-kube-rbac-proxy-sar-config\"" Jul 01 15:12:55.132186 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.132041 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f5851-serving-cert\"" Jul 01 15:12:55.132186 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.132170 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 15:12:55.133165 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.133145 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9cpsj\"" Jul 01 15:12:55.138460 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.138437 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:12:55.310759 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.310728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.310934 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.310773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.411798 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.411722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.411798 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.411764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.412347 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.412322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.414046 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.414029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls\") pod \"switch-graph-f5851-d97c7f4c4-vrgc7\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.440111 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.440084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.496459 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.496428 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:12:55.500106 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.500084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:55.502983 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.502774 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-23f07-kube-rbac-proxy-sar-config\"" Jul 01 15:12:55.503109 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.503091 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-23f07-serving-cert\"" Jul 01 15:12:55.509620 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.509329 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:12:55.573385 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.572875 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:12:55.575362 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:12:55.575336 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bab8ac_98bb_469e_98ac_b0777b0b737d.slice/crio-87a279b115e3569b13cf4c8ca6744bffbdf36af63b7cfe78d8fa48f0597fa3b9 WatchSource:0}: Error finding container 87a279b115e3569b13cf4c8ca6744bffbdf36af63b7cfe78d8fa48f0597fa3b9: Status 404 returned error can't find the container with id 87a279b115e3569b13cf4c8ca6744bffbdf36af63b7cfe78d8fa48f0597fa3b9 Jul 01 15:12:55.613363 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.613334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:55.613509 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.613398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:55.683931 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.683840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" event={"ID":"f5bab8ac-98bb-469e-98ac-b0777b0b737d","Type":"ContainerStarted","Data":"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb"} Jul 01 15:12:55.683931 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.683894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" event={"ID":"f5bab8ac-98bb-469e-98ac-b0777b0b737d","Type":"ContainerStarted","Data":"87a279b115e3569b13cf4c8ca6744bffbdf36af63b7cfe78d8fa48f0597fa3b9"} Jul 01 15:12:55.684133 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.683933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:12:55.700323 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.700266 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podStartSLOduration=0.700246534 podStartE2EDuration="700.246534ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:12:55.700041746 +0000 UTC m=+2011.511724936" watchObservedRunningTime="2026-07-01 15:12:55.700246534 +0000 UTC m=+2011.511929725" Jul 01 15:12:55.714278 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.714249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:55.714445 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.714344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:55.714543 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:12:55.714467 2566 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-23f07-serving-cert: secret "splitter-graph-23f07-serving-cert" not found Jul 01 15:12:55.714613 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:12:55.714565 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls podName:0e2ad91b-fc51-41f3-bd8d-92c87b9602a7 nodeName:}" failed. No retries permitted until 2026-07-01 15:12:56.214543956 +0000 UTC m=+2012.026227129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls") pod "splitter-graph-23f07-6646b676bd-vwjh4" (UID: "0e2ad91b-fc51-41f3-bd8d-92c87b9602a7") : secret "splitter-graph-23f07-serving-cert" not found Jul 01 15:12:55.714969 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:55.714945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:56.218576 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.218538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:56.220920 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.220901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") pod \"splitter-graph-23f07-6646b676bd-vwjh4\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:56.414321 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.414288 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:56.537160 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.537131 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:12:56.540159 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:12:56.540134 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2ad91b_fc51_41f3_bd8d_92c87b9602a7.slice/crio-70864fe84408f632d7df826c4cfdfd7db5ab521ee4fa0d28687058f7d8f93bbe WatchSource:0}: Error finding container 70864fe84408f632d7df826c4cfdfd7db5ab521ee4fa0d28687058f7d8f93bbe: Status 404 returned error can't find the container with id 70864fe84408f632d7df826c4cfdfd7db5ab521ee4fa0d28687058f7d8f93bbe Jul 01 15:12:56.689870 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.689834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" event={"ID":"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7","Type":"ContainerStarted","Data":"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806"} Jul 01 15:12:56.690079 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.689887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" event={"ID":"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7","Type":"ContainerStarted","Data":"70864fe84408f632d7df826c4cfdfd7db5ab521ee4fa0d28687058f7d8f93bbe"} Jul 01 15:12:56.690079 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.690030 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:12:56.708579 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:12:56.708530 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podStartSLOduration=1.708515676 podStartE2EDuration="1.708515676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:12:56.706212362 +0000 UTC m=+2012.517895553" watchObservedRunningTime="2026-07-01 15:12:56.708515676 +0000 UTC m=+2012.520198929" Jul 01 15:13:01.695849 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:13:01.695820 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:13:02.700457 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:13:02.700416 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:14:24.695284 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:14:24.695208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:14:24.695850 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:14:24.695743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:19:24.715090 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:19:24.715064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:19:24.717759 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:19:24.717691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:21:10.096551 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:10.096522 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:21:10.097041 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:10.096717 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" containerID="cri-o://48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806" gracePeriod=30 Jul 01 15:21:12.698122 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:12.698086 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:17.698785 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:17.698704 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:22.698567 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:22.698522 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:22.699008 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:22.698643 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:21:27.698433 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:27.698396 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:32.698457 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:32.698415 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:37.698280 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:37.698243 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:21:40.239747 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.239724 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:21:40.352479 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.352397 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle\") pod \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " Jul 01 15:21:40.352479 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.352459 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") pod \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\" (UID: \"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7\") " Jul 01 15:21:40.352796 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.352774 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" (UID: "0e2ad91b-fc51-41f3-bd8d-92c87b9602a7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:21:40.354414 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.354397 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" (UID: "0e2ad91b-fc51-41f3-bd8d-92c87b9602a7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:21:40.453532 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.453504 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:21:40.453532 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.453529 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:21:40.464591 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.464565 2566 generic.go:356] "Generic (PLEG): container finished" podID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerID="48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806" exitCode=0 Jul 01 15:21:40.464729 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.464609 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" Jul 01 15:21:40.464729 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.464627 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" event={"ID":"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7","Type":"ContainerDied","Data":"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806"} Jul 01 15:21:40.464729 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.464669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4" event={"ID":"0e2ad91b-fc51-41f3-bd8d-92c87b9602a7","Type":"ContainerDied","Data":"70864fe84408f632d7df826c4cfdfd7db5ab521ee4fa0d28687058f7d8f93bbe"} Jul 01 15:21:40.464729 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.464702 2566 scope.go:117] "RemoveContainer" containerID="48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806" Jul 01 15:21:40.473080 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.473063 2566 scope.go:117] "RemoveContainer" containerID="48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806" Jul 01 15:21:40.473384 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:21:40.473330 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806\": container with ID starting with 48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806 not found: ID does not exist" containerID="48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806" Jul 01 15:21:40.473384 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.473366 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806"} err="failed to get container status \"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806\": rpc error: code = NotFound desc = could not find container \"48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806\": container with ID starting with 48de2cb17c16a77dfa4973c1503c4f36f9ac435641d7c40ce10a8051b3ab8806 not found: ID does not exist" Jul 01 15:21:40.487609 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.487587 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:21:40.491893 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.491869 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-23f07-6646b676bd-vwjh4"] Jul 01 15:21:40.630747 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:21:40.630680 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" path="/var/lib/kubelet/pods/0e2ad91b-fc51-41f3-bd8d-92c87b9602a7/volumes" Jul 01 15:24:24.740502 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:24:24.740358 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:24:24.744654 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:24:24.743149 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:29:14.574420 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:14.574342 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:29:14.574961 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:14.574614 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" containerID="cri-o://6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb" gracePeriod=30 Jul 01 15:29:16.694379 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:16.694334 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:21.694552 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:21.694502 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:24.761710 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:24.761597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:29:24.765130 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:24.763623 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:29:26.694170 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:26.694132 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:26.694561 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:26.694228 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:29:31.694631 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:31.694596 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:32.829429 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:32.829394 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:33.761450 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:33.761417 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:34.630885 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:34.630856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:35.462148 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:35.462120 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:36.325613 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:36.325586 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:36.693726 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:36.693688 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:37.218707 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:37.218668 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:38.076569 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:38.076542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:38.917792 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:38.917753 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:39.750544 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:39.750514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:40.596653 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:40.596619 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:41.459738 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:41.459701 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:41.694105 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:41.694072 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 15:29:42.336500 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:42.336447 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:43.234429 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:43.234400 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:44.123399 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.123371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f5851-d97c7f4c4-vrgc7_f5bab8ac-98bb-469e-98ac-b0777b0b737d/switch-graph-f5851/0.log" Jul 01 15:29:44.719634 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.719614 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:29:44.843769 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.843733 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle\") pod \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " Jul 01 15:29:44.843968 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.843812 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls\") pod \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\" (UID: \"f5bab8ac-98bb-469e-98ac-b0777b0b737d\") " Jul 01 15:29:44.844157 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.844136 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f5bab8ac-98bb-469e-98ac-b0777b0b737d" (UID: "f5bab8ac-98bb-469e-98ac-b0777b0b737d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 15:29:44.845854 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.845838 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f5bab8ac-98bb-469e-98ac-b0777b0b737d" (UID: "f5bab8ac-98bb-469e-98ac-b0777b0b737d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 15:29:44.945346 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.945312 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5bab8ac-98bb-469e-98ac-b0777b0b737d-openshift-service-ca-bundle\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:29:44.945346 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:44.945338 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f5bab8ac-98bb-469e-98ac-b0777b0b737d-proxy-tls\") on node \"ip-10-0-137-172.ec2.internal\" DevicePath \"\"" Jul 01 15:29:45.096579 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.096472 2566 generic.go:356] "Generic (PLEG): container finished" podID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerID="6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb" exitCode=137 Jul 01 15:29:45.096579 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.096526 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" Jul 01 15:29:45.096579 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.096562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" event={"ID":"f5bab8ac-98bb-469e-98ac-b0777b0b737d","Type":"ContainerDied","Data":"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb"} Jul 01 15:29:45.096779 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.096618 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7" event={"ID":"f5bab8ac-98bb-469e-98ac-b0777b0b737d","Type":"ContainerDied","Data":"87a279b115e3569b13cf4c8ca6744bffbdf36af63b7cfe78d8fa48f0597fa3b9"} Jul 01 15:29:45.096779 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.096647 2566 scope.go:117] "RemoveContainer" containerID="6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb" Jul 01 15:29:45.104777 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.104756 2566 scope.go:117] "RemoveContainer" containerID="6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb" Jul 01 15:29:45.105050 ip-10-0-137-172 kubenswrapper[2566]: E0701 15:29:45.105031 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb\": container with ID starting with 6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb not found: ID does not exist" containerID="6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb" Jul 01 15:29:45.105148 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.105059 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb"} err="failed to get container status \"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb\": rpc error: code = NotFound desc = could not find container \"6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb\": container with ID starting with 6bcde5488fb1053f0d75682e3249b9f17c4695d18610244dd4eebe34e4e7e1fb not found: ID does not exist" Jul 01 15:29:45.118374 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.118353 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:29:45.122717 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:45.122697 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f5851-d97c7f4c4-vrgc7"] Jul 01 15:29:46.454717 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.454680 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wp8cx/must-gather-p2j6t"] Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.454937 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.454948 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.454963 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.454968 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.455008 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" containerName="switch-graph-f5851" Jul 01 15:29:46.455064 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.455018 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2ad91b-fc51-41f3-bd8d-92c87b9602a7" containerName="splitter-graph-23f07" Jul 01 15:29:46.459148 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.459132 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.462348 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.462327 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wp8cx\"/\"default-dockercfg-ddj5c\"" Jul 01 15:29:46.462476 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.462436 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wp8cx\"/\"openshift-service-ca.crt\"" Jul 01 15:29:46.462650 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.462635 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wp8cx\"/\"kube-root-ca.crt\"" Jul 01 15:29:46.468575 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.468555 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp8cx/must-gather-p2j6t"] Jul 01 15:29:46.554907 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.554879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7v6p\" (UniqueName: \"kubernetes.io/projected/c2d881af-e579-4988-8ee6-938cf7a1022a-kube-api-access-q7v6p\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.555038 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.554924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c2d881af-e579-4988-8ee6-938cf7a1022a-must-gather-output\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.630645 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.630615 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5bab8ac-98bb-469e-98ac-b0777b0b737d" path="/var/lib/kubelet/pods/f5bab8ac-98bb-469e-98ac-b0777b0b737d/volumes" Jul 01 15:29:46.655631 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.655608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7v6p\" (UniqueName: \"kubernetes.io/projected/c2d881af-e579-4988-8ee6-938cf7a1022a-kube-api-access-q7v6p\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.655787 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.655642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c2d881af-e579-4988-8ee6-938cf7a1022a-must-gather-output\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.655938 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.655909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c2d881af-e579-4988-8ee6-938cf7a1022a-must-gather-output\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.666232 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.666211 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7v6p\" (UniqueName: \"kubernetes.io/projected/c2d881af-e579-4988-8ee6-938cf7a1022a-kube-api-access-q7v6p\") pod \"must-gather-p2j6t\" (UID: \"c2d881af-e579-4988-8ee6-938cf7a1022a\") " pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.768991 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.768910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" Jul 01 15:29:46.891062 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.890897 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp8cx/must-gather-p2j6t"] Jul 01 15:29:46.893733 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:29:46.893706 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2d881af_e579_4988_8ee6_938cf7a1022a.slice/crio-54445d3b265b329c72d3c54bec82acaf9cda32691cfe757e21b3ff450b34a20e WatchSource:0}: Error finding container 54445d3b265b329c72d3c54bec82acaf9cda32691cfe757e21b3ff450b34a20e: Status 404 returned error can't find the container with id 54445d3b265b329c72d3c54bec82acaf9cda32691cfe757e21b3ff450b34a20e Jul 01 15:29:46.896007 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:46.895991 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 15:29:47.105698 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:47.105666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" event={"ID":"c2d881af-e579-4988-8ee6-938cf7a1022a","Type":"ContainerStarted","Data":"54445d3b265b329c72d3c54bec82acaf9cda32691cfe757e21b3ff450b34a20e"} Jul 01 15:29:48.111885 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:48.111806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" event={"ID":"c2d881af-e579-4988-8ee6-938cf7a1022a","Type":"ContainerStarted","Data":"9e7844b12a171f9ef522fef0a3973269872dbf5ca113f6871f2816d633b43e86"} Jul 01 15:29:48.111885 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:48.111858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" event={"ID":"c2d881af-e579-4988-8ee6-938cf7a1022a","Type":"ContainerStarted","Data":"5d783390dbddd85c285db53a9f9e8424e118fb7d4c7fc6ad55c7fb7e0b7332c1"} Jul 01 15:29:48.157724 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:48.157673 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wp8cx/must-gather-p2j6t" podStartSLOduration=1.1912282969999999 podStartE2EDuration="2.157657907s" totalImagesPullingTime="966.42961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 15:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:29:48.155900836 +0000 UTC m=+3023.967584028" watchObservedRunningTime="2026-07-01 15:29:48.157657907 +0000 UTC m=+3023.969341098" Jul 01 15:29:49.380765 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:49.380737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hkm8p_6e97e24e-fb24-43a4-b0b4-3fe4ab1efb4b/global-pull-secret-syncer/0.log" Jul 01 15:29:49.547169 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:49.547133 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xvglq_6871e29f-d49d-43b2-af91-5593fbb95190/konnectivity-agent/0.log" Jul 01 15:29:49.594091 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:49.594064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-172.ec2.internal_1d2f8c8a24b804aabf001b0ab0732993/haproxy/0.log" Jul 01 15:29:53.544661 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.544584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4mvw_e6321d32-4ed0-4744-8903-19c314386816/node-exporter/0.log" Jul 01 15:29:53.575035 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.574991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4mvw_e6321d32-4ed0-4744-8903-19c314386816/kube-rbac-proxy/0.log" Jul 01 15:29:53.607136 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.607104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4mvw_e6321d32-4ed0-4744-8903-19c314386816/init-textfile/0.log" Jul 01 15:29:53.789672 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.789638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/prometheus/0.log" Jul 01 15:29:53.817534 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.817415 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/config-reloader/0.log" Jul 01 15:29:53.865511 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.865403 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/thanos-sidecar/0.log" Jul 01 15:29:53.896152 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.896119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/kube-rbac-proxy-web/0.log" Jul 01 15:29:53.927042 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.927010 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/kube-rbac-proxy/0.log" Jul 01 15:29:53.956673 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.956639 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/kube-rbac-proxy-thanos/0.log" Jul 01 15:29:53.994143 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:53.994073 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_db1e1e7a-1e9a-4c29-adf1-023d9b312d7b/init-config-reloader/0.log" Jul 01 15:29:57.737602 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.737570 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr"] Jul 01 15:29:57.741406 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.741375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.752688 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.752619 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr"] Jul 01 15:29:57.843070 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.843029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-podres\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.843321 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.843302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-sys\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.843515 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.843479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-lib-modules\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.843692 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.843667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-proc\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.843813 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.843698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzp5\" (UniqueName: \"kubernetes.io/projected/df894cc1-ff04-4a82-9dcb-0178118d5655-kube-api-access-jxzp5\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944647 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-proc\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzp5\" (UniqueName: \"kubernetes.io/projected/df894cc1-ff04-4a82-9dcb-0178118d5655-kube-api-access-jxzp5\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-podres\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-sys\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944740 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-proc\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-lib-modules\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.944835 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-sys\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.945047 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-podres\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.945047 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.944899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df894cc1-ff04-4a82-9dcb-0178118d5655-lib-modules\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:57.954773 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:57.954720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzp5\" (UniqueName: \"kubernetes.io/projected/df894cc1-ff04-4a82-9dcb-0178118d5655-kube-api-access-jxzp5\") pod \"perf-node-gather-daemonset-vqphr\" (UID: \"df894cc1-ff04-4a82-9dcb-0178118d5655\") " pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:58.054782 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:58.054708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:58.220476 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:58.220388 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr"] Jul 01 15:29:58.227517 ip-10-0-137-172 kubenswrapper[2566]: W0701 15:29:58.227453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf894cc1_ff04_4a82_9dcb_0178118d5655.slice/crio-6e080d83bf6255ed6288e59aeb8243c726b1caf58e4ce21f84ca4987bd008924 WatchSource:0}: Error finding container 6e080d83bf6255ed6288e59aeb8243c726b1caf58e4ce21f84ca4987bd008924: Status 404 returned error can't find the container with id 6e080d83bf6255ed6288e59aeb8243c726b1caf58e4ce21f84ca4987bd008924 Jul 01 15:29:58.350404 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:58.350355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8kh9n_db856bb3-83c3-478e-af26-6289fc1773c7/dns/0.log" Jul 01 15:29:58.375707 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:58.375673 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8kh9n_db856bb3-83c3-478e-af26-6289fc1773c7/kube-rbac-proxy/0.log" Jul 01 15:29:58.555599 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:58.555572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s95lc_af32473b-d0ec-4dc2-8452-f218e629e923/dns-node-resolver/0.log" Jul 01 15:29:59.117110 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:59.117074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r868z_f71da8cc-1f71-4a7b-bc48-35d8978bec7a/node-ca/0.log" Jul 01 15:29:59.166892 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:59.166862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" event={"ID":"df894cc1-ff04-4a82-9dcb-0178118d5655","Type":"ContainerStarted","Data":"1f486220758039ad496a8ae41635e762137f1fb07e613bf9f029dbf7162e1ed3"} Jul 01 15:29:59.167058 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:59.166918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" event={"ID":"df894cc1-ff04-4a82-9dcb-0178118d5655","Type":"ContainerStarted","Data":"6e080d83bf6255ed6288e59aeb8243c726b1caf58e4ce21f84ca4987bd008924"} Jul 01 15:29:59.167058 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:59.167046 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:29:59.187370 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:29:59.187320 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" podStartSLOduration=2.187300541 podStartE2EDuration="2.187300541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 15:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 15:29:59.186687552 +0000 UTC m=+3034.998370744" watchObservedRunningTime="2026-07-01 15:29:59.187300541 +0000 UTC m=+3034.998983734" Jul 01 15:30:00.342449 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:00.342419 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wrx2j_72c89e91-056f-4467-aff8-54c5b7b12493/serve-healthcheck-canary/0.log" Jul 01 15:30:00.866921 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:00.866888 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2hf_b8e10c15-c5a4-4afd-aee5-df09209053da/kube-rbac-proxy/0.log" Jul 01 15:30:00.890684 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:00.890658 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2hf_b8e10c15-c5a4-4afd-aee5-df09209053da/exporter/0.log" Jul 01 15:30:00.913991 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:00.913960 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2hf_b8e10c15-c5a4-4afd-aee5-df09209053da/extractor/0.log" Jul 01 15:30:05.181204 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:05.181175 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wp8cx/perf-node-gather-daemonset-vqphr" Jul 01 15:30:07.482289 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:07.482207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-bnc6g_190a0fb8-eecc-42e3-bb13-5d5c420c9753/migrator/0.log" Jul 01 15:30:07.545270 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:07.545241 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-bnc6g_190a0fb8-eecc-42e3-bb13-5d5c420c9753/graceful-termination/0.log" Jul 01 15:30:08.866621 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.866584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/kube-multus-additional-cni-plugins/0.log" Jul 01 15:30:08.892629 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.892602 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/egress-router-binary-copy/0.log" Jul 01 15:30:08.916989 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.916897 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/cni-plugins/0.log" Jul 01 15:30:08.937977 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.937954 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/bond-cni-plugin/0.log" Jul 01 15:30:08.959900 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.959811 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/routeoverride-cni/0.log" Jul 01 15:30:08.985370 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:08.985346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/whereabouts-cni-bincopy/0.log" Jul 01 15:30:09.006452 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:09.006423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95ctp_478b1e87-9842-4629-a6cf-993cc6609979/whereabouts-cni/0.log" Jul 01 15:30:09.437579 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:09.437540 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zfc2w_f82ce774-e750-4c54-9195-ff4743f8ae0d/kube-multus/0.log" Jul 01 15:30:09.459733 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:09.459660 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sll4_199cf7ce-2384-4654-a6c2-fbe512e4affc/network-metrics-daemon/0.log" Jul 01 15:30:09.481109 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:09.481080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sll4_199cf7ce-2384-4654-a6c2-fbe512e4affc/kube-rbac-proxy/0.log" Jul 01 15:30:10.545589 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.545563 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-controller/0.log" Jul 01 15:30:10.561638 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.561617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/1.log" Jul 01 15:30:10.561789 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.561722 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovn-acl-logging/0.log" Jul 01 15:30:10.585132 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.585110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/kube-rbac-proxy-node/0.log" Jul 01 15:30:10.619516 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.619476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 15:30:10.659055 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.659030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/northd/0.log" Jul 01 15:30:10.722508 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.722464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/nbdb/0.log" Jul 01 15:30:10.768002 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.767965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/sbdb/0.log" Jul 01 15:30:10.834077 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:10.833992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj8xd_076fa509-880f-42cd-be0e-a75d973a1d82/ovnkube-controller/0.log" Jul 01 15:30:12.064847 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:12.064818 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bgqt2_506dfc42-ad2e-4482-9361-a274a9d4f770/network-check-target-container/0.log" Jul 01 15:30:13.017568 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:13.017540 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5pdr8_5fa63f6c-5c19-49bb-8a74-90f3af56c14a/iptables-alerter/0.log" Jul 01 15:30:13.795463 ip-10-0-137-172 kubenswrapper[2566]: I0701 15:30:13.795432 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-g2gns_3c548c18-bb77-4fcc-9c9c-3a59c8875b31/tuned/0.log"