Jun 08 15:33:46.934044 ip-10-0-141-19 systemd[1]: Starting Kubernetes Kubelet... Jun 08 15:33:47.357923 ip-10-0-141-19 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:33:47.357923 ip-10-0-141-19 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 15:33:47.357923 ip-10-0-141-19 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:33:47.357923 ip-10-0-141-19 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 15:33:47.357923 ip-10-0-141-19 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:33:47.358661 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.357992 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 15:33:47.364664 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364644 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.364664 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364664 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364668 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364672 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364675 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364677 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364681 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364683 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364687 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364690 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364692 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364695 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364698 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364701 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364704 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364706 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364709 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364711 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364714 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364716 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.364738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364720 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364722 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364734 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364737 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364740 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364743 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364746 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364749 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364751 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364754 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364757 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364759 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364763 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364768 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364771 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364773 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364776 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364779 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364781 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364783 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.365185 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364786 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364789 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364791 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364794 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364796 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364799 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364802 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364805 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364807 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364810 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364812 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364815 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364817 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364820 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364823 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364826 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364828 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364830 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364833 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364836 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.365693 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364838 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364841 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364843 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364845 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364850 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364854 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364856 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364859 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364861 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364864 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364867 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364869 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364872 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364874 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364876 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364879 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364882 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364887 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364889 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364891 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.366210 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364895 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364897 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364901 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364905 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364908 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364911 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364914 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364917 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364921 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364924 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364927 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364930 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364933 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364936 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364939 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364941 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364944 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364947 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.364950 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.366705 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365671 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365680 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365683 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365686 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365689 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365692 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365694 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365697 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365699 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365702 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365705 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365708 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365711 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365713 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365716 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365719 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365721 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365724 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365726 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365730 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.367175 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365733 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365736 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365739 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365741 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365744 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365746 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365749 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365751 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365754 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365757 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365759 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365762 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365764 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365767 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365770 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365773 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365775 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365779 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365783 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.367694 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365786 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365789 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365791 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365794 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365797 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365799 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365802 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365806 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365815 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365819 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365821 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365824 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365828 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365831 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365834 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365836 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365839 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365841 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365844 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.368163 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365847 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365849 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365852 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365855 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365857 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365860 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365862 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365866 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365870 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365873 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365875 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365878 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365880 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365883 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365886 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365888 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365891 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365893 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365896 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365900 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.368652 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365903 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365905 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365908 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365911 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365913 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365916 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365919 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365921 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365924 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365927 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365929 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365932 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365934 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365936 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365939 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365941 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365944 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365947 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365949 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365952 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.369135 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.365954 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366364 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366369 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366372 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366376 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366379 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366382 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366386 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366389 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366392 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366396 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366399 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366402 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366405 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366408 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366411 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366414 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366417 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366419 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366422 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.369636 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366424 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366427 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366430 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366432 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366435 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366438 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366440 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366443 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366445 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366449 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366452 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366455 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366458 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366461 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366463 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366466 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366469 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366471 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366474 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.370108 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366476 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366479 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366481 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366483 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366486 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366489 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366492 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366494 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366498 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366500 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366503 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366505 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366508 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366512 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366515 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366517 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366519 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366522 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366525 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.370574 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366527 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366529 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366532 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366534 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366537 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366540 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366543 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366546 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366548 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366551 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366553 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366555 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366558 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366560 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366563 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366565 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366568 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366570 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366573 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366576 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.371100 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366578 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366581 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366584 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366586 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366589 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366591 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366607 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366610 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366613 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366615 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366618 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366621 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366623 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366625 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366628 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366630 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366633 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366636 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366641 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366644 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.371587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366647 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.366649 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366716 2553 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366723 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366730 2553 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366734 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366739 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366742 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366746 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366750 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366753 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366756 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366760 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366763 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366766 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366770 2553 flags.go:64] FLAG: --cgroup-root="" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366773 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366776 2553 flags.go:64] FLAG: --client-ca-file="" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366779 2553 flags.go:64] FLAG: --cloud-provider="external" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366782 2553 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366785 2553 flags.go:64] FLAG: --cluster-domain="" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366789 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366792 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366795 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 15:33:47.372109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366798 2553 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366802 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366805 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366808 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366812 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366815 2553 flags.go:64] FLAG: --contention-profiling="false" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366819 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366823 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366826 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366829 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366833 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366836 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366839 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366842 2553 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366845 2553 flags.go:64] FLAG: --enable-server="true" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366848 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366853 2553 flags.go:64] FLAG: --event-burst="100" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366856 2553 flags.go:64] FLAG: --event-qps="50" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366859 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366862 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366865 2553 flags.go:64] FLAG: --eviction-hard="" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366868 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366871 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366874 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366878 2553 flags.go:64] FLAG: --eviction-soft="" Jun 08 15:33:47.372698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366881 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366884 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366887 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366890 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366893 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366896 2553 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366899 2553 flags.go:64] FLAG: --feature-gates="" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366903 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366906 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366909 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366912 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366915 2553 flags.go:64] FLAG: --healthz-port="10248" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366918 2553 flags.go:64] FLAG: --help="false" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366922 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366925 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366928 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366931 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366934 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366938 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366941 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366946 2553 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366949 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366952 2553 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 15:33:47.373296 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366955 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366958 2553 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366961 2553 flags.go:64] FLAG: --kube-reserved="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366963 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366966 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366969 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366972 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366975 2553 flags.go:64] FLAG: --lock-file="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366978 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366981 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366984 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366990 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366993 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366996 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.366999 2553 flags.go:64] FLAG: --logging-format="text" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367001 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367005 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367008 2553 flags.go:64] FLAG: --manifest-url="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367010 2553 flags.go:64] FLAG: --manifest-url-header="" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367015 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367017 2553 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367022 2553 flags.go:64] FLAG: --max-pods="110" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367026 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367029 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367032 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 15:33:47.373904 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367034 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367037 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367040 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367044 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367052 2553 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367055 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367058 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367061 2553 flags.go:64] FLAG: --pod-cidr="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367063 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367069 2553 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367079 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367083 2553 flags.go:64] FLAG: --pods-per-core="0" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367087 2553 flags.go:64] FLAG: --port="10250" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367090 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367093 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a53d2f69080986cb" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367096 2553 flags.go:64] FLAG: --qos-reserved="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367099 2553 flags.go:64] FLAG: --read-only-port="10255" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367103 2553 flags.go:64] FLAG: --register-node="true" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367106 2553 flags.go:64] FLAG: --register-with-taints="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367110 2553 flags.go:64] FLAG: --registry-burst="10" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367112 2553 flags.go:64] FLAG: --registry-qps="5" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367115 2553 flags.go:64] FLAG: --reserved-cpus="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367119 2553 flags.go:64] FLAG: --reserved-memory="" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367122 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367125 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 15:33:47.374548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367142 2553 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367146 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367149 2553 flags.go:64] FLAG: --runonce="false" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367152 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367155 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367160 2553 flags.go:64] FLAG: --seccomp-default="false" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367163 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367166 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367169 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367172 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367175 2553 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367180 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367183 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367186 2553 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367189 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367192 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367195 2553 flags.go:64] FLAG: --system-cgroups="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367198 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367203 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367206 2553 flags.go:64] FLAG: --tls-cert-file="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367209 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367213 2553 flags.go:64] FLAG: --tls-min-version="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367216 2553 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367219 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367221 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 15:33:47.375266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367225 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367228 2553 flags.go:64] FLAG: --v="2" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367233 2553 flags.go:64] FLAG: --version="false" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367237 2553 flags.go:64] FLAG: --vmodule="" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367240 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.367243 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367359 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367363 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367366 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367369 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367372 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367375 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367379 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367382 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367385 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367387 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367390 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367393 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367397 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367400 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367403 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.375962 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367406 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367408 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367411 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367413 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367418 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367421 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367424 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367427 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367429 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367433 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367435 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367437 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367441 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367443 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367446 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367449 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367452 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367454 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367457 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367459 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.376476 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367462 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367465 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367468 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367475 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367478 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367481 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367483 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367486 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367489 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367494 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367497 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367500 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367502 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367505 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367508 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367511 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367513 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367516 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367518 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.376981 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367521 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367523 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367527 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367529 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367532 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367534 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367537 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367540 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367543 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367546 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367548 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367551 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367553 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367556 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367560 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367563 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367569 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367572 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367575 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.377452 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367577 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367580 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367582 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367586 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367589 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367592 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367609 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367612 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367615 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367618 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367620 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367623 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367625 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367628 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367630 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367633 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367636 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367638 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367641 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367644 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.377937 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367647 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367650 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367653 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367655 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367658 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.367660 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.368243 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.375470 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.375488 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.375502 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.375509 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375581 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375585 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375588 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375591 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.378461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375608 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375622 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375624 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375627 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375630 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375633 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375635 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375638 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375640 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375643 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375646 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375648 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375651 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375653 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375656 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375658 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375661 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375664 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375666 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.378868 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375670 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375674 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375677 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375680 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375682 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375685 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375695 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375698 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375701 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375704 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375707 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375709 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375712 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375715 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375718 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375720 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375723 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375725 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375728 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375731 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.379348 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375733 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375736 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375738 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375741 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375744 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375746 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375749 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375752 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375754 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375757 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375759 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375761 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375764 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375766 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375769 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375771 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375774 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375777 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375779 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.379920 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375788 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375790 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375793 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375795 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375798 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375802 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375806 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375808 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375811 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375813 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375816 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375818 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375821 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375824 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375826 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375829 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375832 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375835 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375837 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375839 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.380380 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375842 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375844 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375847 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375849 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375853 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375856 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375859 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375862 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375865 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375868 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375870 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375873 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375875 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375884 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375886 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375889 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.380891 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.375892 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.375897 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376075 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376082 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376085 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376088 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376091 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376094 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376097 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376101 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376105 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376108 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376111 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376113 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376116 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:33:47.381273 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376119 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376122 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376125 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376127 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376130 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376132 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376135 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376138 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376140 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376143 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376145 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376148 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376151 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376153 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376156 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376164 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376166 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376169 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376172 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:33:47.381657 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376175 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376177 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376180 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376182 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376185 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376187 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376190 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376192 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376195 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376197 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376200 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376202 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376205 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376207 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376209 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376212 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376214 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376217 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376220 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376222 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:33:47.382114 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376224 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376227 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376230 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376232 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376235 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376237 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376240 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376243 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376245 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376256 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376259 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376262 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376265 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376268 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376271 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376274 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376276 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376279 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376281 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376284 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:33:47.382605 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376286 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376290 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376293 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376296 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376299 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376302 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376305 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376307 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376310 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376313 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376315 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376318 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376320 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376322 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376325 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376327 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376330 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376333 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376335 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:33:47.383113 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376338 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376340 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376343 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376351 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376353 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376356 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376358 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:47.376361 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.376365 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.376512 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.378583 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.379891 2553 server.go:1019] "Starting client certificate rotation" Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.379993 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 15:33:47.383674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.380032 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 15:33:47.383998 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.382316 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 15:33:47.388759 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.388734 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 15:33:47.402227 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.402196 2553 log.go:25] "Validated CRI v1 runtime API" Jun 08 15:33:47.404696 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.404682 2553 log.go:25] "Validated CRI v1 image API" Jun 08 15:33:47.406380 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.406364 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 15:33:47.409150 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.409129 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d7413b60-2da9-4317-bbc2-315c24964b16:/dev/nvme0n1p3 f7f3d6c4-b4ec-4635-98c0-22dadeca92db:/dev/nvme0n1p4] Jun 08 15:33:47.409213 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.409150 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 15:33:47.414925 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.414815 2553 manager.go:216] Machine: {Timestamp:2026-06-08 15:33:47.413521919 +0000 UTC m=+0.353973206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097556 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2575a4bbfff78b2d0f39aedfe049e7 SystemUUID:ec2575a4-bbff-f78b-2d0f-39aedfe049e7 BootID:e6d75d09-451b-4880-a5e0-eb3024fe00c8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:75:d1:28:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:75:d1:28:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:dd:c1:09:44:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 15:33:47.414925 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.414920 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 15:33:47.415034 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.415015 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 15:33:47.417608 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.417566 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 15:33:47.417760 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.417622 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 15:33:47.418016 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.418000 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 15:33:47.418329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.418318 2553 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 15:33:47.418372 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.418332 2553 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 15:33:47.418372 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.418341 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 15:33:47.418983 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.418970 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 15:33:47.419833 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.419824 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 15:33:47.423025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423013 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 08 15:33:47.423152 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423142 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 15:33:47.423184 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423175 2553 kubelet.go:486] "Attempting to sync node with API server" Jun 08 15:33:47.423211 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423185 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 15:33:47.423211 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423202 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 15:33:47.423265 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423215 2553 kubelet.go:398] "Adding apiserver pod source" Jun 08 15:33:47.423265 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423228 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 15:33:47.423699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423685 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 15:33:47.423736 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.423715 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 15:33:47.426136 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.426115 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 15:33:47.427884 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.427871 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 15:33:47.427938 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.427902 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 15:33:47.428974 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.428964 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 15:33:47.429008 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.428981 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 15:33:47.429008 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.428987 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 15:33:47.429008 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.428993 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 15:33:47.429008 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429002 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 15:33:47.429008 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429008 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429017 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429023 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429030 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429035 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429044 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 15:33:47.429135 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.429050 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 15:33:47.430250 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.430240 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 15:33:47.430250 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.430251 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 15:33:47.433658 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.433645 2553 server.go:1268] "Started kubelet" Jun 08 15:33:47.433763 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.433712 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 15:33:47.437262 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.437201 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 15:33:47.438298 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.437546 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 15:33:47.438298 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.438081 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 15:33:47.438298 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.438152 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 15:33:47.438076 ip-10-0-141-19 systemd[1]: Started Kubernetes Kubelet. Jun 08 15:33:47.438845 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.438382 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-19.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 15:33:47.439749 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.439528 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9whmt" Jun 08 15:33:47.439880 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.439750 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 15:33:47.441003 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.440959 2553 server.go:310] "Adding debug handlers to kubelet server" Jun 08 15:33:47.444012 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.443050 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-19.ec2.internal.18b724f884034c94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-19.ec2.internal,UID:ip-10-0-141-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-19.ec2.internal,},FirstTimestamp:2026-06-08 15:33:47.43361858 +0000 UTC m=+0.374069868,LastTimestamp:2026-06-08 15:33:47.43361858 +0000 UTC m=+0.374069868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-19.ec2.internal,}" Jun 08 15:33:47.444106 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.444030 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 15:33:47.446025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.446010 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9whmt" Jun 08 15:33:47.447916 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.447898 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 15:33:47.447991 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.447921 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 15:33:47.448047 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.447986 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.448621 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448460 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 15:33:47.448621 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448476 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 15:33:47.448621 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448516 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 15:33:47.448805 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448672 2553 reconstruct.go:97] "Volume reconstruction finished" Jun 08 15:33:47.448805 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448681 2553 reconciler.go:29] "Reconciler: start to sync state" Jun 08 15:33:47.448805 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448726 2553 factory.go:55] Registering systemd factory Jun 08 15:33:47.448805 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448765 2553 factory.go:223] Registration of the systemd container factory successfully Jun 08 15:33:47.449164 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.448969 2553 factory.go:153] Registering CRI-O factory Jun 08 15:33:47.449256 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.449167 2553 factory.go:223] Registration of the crio container factory successfully Jun 08 15:33:47.449256 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.449212 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 15:33:47.449256 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.449232 2553 factory.go:103] Registering Raw factory Jun 08 15:33:47.449256 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.449244 2553 manager.go:1196] Started watching for new ooms in manager Jun 08 15:33:47.449562 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.449551 2553 manager.go:349] Starting recovery of all containers Jun 08 15:33:47.456019 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.455988 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 15:33:47.456960 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.456937 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:47.459090 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.459065 2553 manager.go:354] Recovery completed Jun 08 15:33:47.459757 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.459733 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-19.ec2.internal\" not found" node="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.463257 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.463245 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.465110 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465090 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.465183 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465124 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.465183 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465140 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.465714 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465701 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 15:33:47.465714 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465708 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.465830 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465714 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 15:33:47.465830 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.465737 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 08 15:33:47.466414 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.466399 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.466478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.466430 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.466478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.466444 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.467261 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.467250 2553 policy_none.go:49] "None policy: Start" Jun 08 15:33:47.467308 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.467266 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 15:33:47.467308 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.467276 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 15:33:47.468282 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.468272 2553 policy_none.go:47] "Start" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.506866 2553 manager.go:337] "Starting Device Plugin manager" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.506900 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.506913 2553 server.go:87] "Starting device plugin registration server" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.507320 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.507332 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.507440 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.507530 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.507539 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.508010 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.508054 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.518500 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.518540 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.518560 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.518590 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 15:33:47.522349 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.520664 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:47.607664 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.607618 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.608629 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.608560 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.608629 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.608590 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.608629 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.608622 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.608759 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.608652 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.616448 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.616431 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.616519 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.616455 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-19.ec2.internal\": node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.618807 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.618787 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal"] Jun 08 15:33:47.618895 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.618857 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.620090 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.620074 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.620177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.620100 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.620177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.620110 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.621239 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621227 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.621355 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.621402 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621360 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.621903 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621891 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.621963 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621912 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.621963 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621921 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.621963 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621942 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.622061 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621964 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.622061 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.621977 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.623216 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.623202 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.623266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.623229 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:33:47.623884 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.623871 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:33:47.623938 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.623896 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:33:47.623938 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.623911 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:33:47.628717 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.628703 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.650413 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.650392 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.650504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.650419 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9338fa01d9ee5659f0df90fbdc92c33e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-19.ec2.internal\" (UID: \"9338fa01d9ee5659f0df90fbdc92c33e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.650504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.650436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.650504 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.650439 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-19.ec2.internal\" not found" node="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.654950 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.654934 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-19.ec2.internal\" not found" node="ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.729220 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.729195 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.750993 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.750970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.751081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.750997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.751081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.751015 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9338fa01d9ee5659f0df90fbdc92c33e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-19.ec2.internal\" (UID: \"9338fa01d9ee5659f0df90fbdc92c33e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.751081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.751069 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9338fa01d9ee5659f0df90fbdc92c33e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-19.ec2.internal\" (UID: \"9338fa01d9ee5659f0df90fbdc92c33e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.751189 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.751094 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.751189 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.751100 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0635057a5e3034fa018046fb4304882c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal\" (UID: \"0635057a5e3034fa018046fb4304882c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.829903 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.829863 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.930664 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:47.930581 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:47.954065 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.954038 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:47.958552 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:47.958525 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:48.031277 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:48.031234 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:48.131795 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:48.131762 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:48.232283 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:48.232206 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:48.332793 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:48.332753 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-19.ec2.internal\" not found" Jun 08 15:33:48.379214 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.379183 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 15:33:48.379702 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.379338 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 15:33:48.379702 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.379365 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 15:33:48.425946 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.425921 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:48.426510 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.426494 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:48.448329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.448304 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 15:33:48.448329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.448306 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" Jun 08 15:33:48.450466 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.450445 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 15:28:47 +0000 UTC" deadline="2027-12-22 04:19:20.09714575 +0000 UTC" Jun 08 15:33:48.450519 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.450466 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13476h45m31.646681993s" Jun 08 15:33:48.458630 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.458611 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 15:33:48.459726 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.459714 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" Jun 08 15:33:48.460866 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.460844 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 15:33:48.466021 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.466009 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 15:33:48.480717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.480698 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ctvjp" Jun 08 15:33:48.488180 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.488139 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ctvjp" Jun 08 15:33:48.598456 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:48.598422 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0635057a5e3034fa018046fb4304882c.slice/crio-f6ac6f771eee89e12da5bd5dfc25d192db2a3f127abbabce31576cee81596691 WatchSource:0}: Error finding container f6ac6f771eee89e12da5bd5dfc25d192db2a3f127abbabce31576cee81596691: Status 404 returned error can't find the container with id f6ac6f771eee89e12da5bd5dfc25d192db2a3f127abbabce31576cee81596691 Jun 08 15:33:48.599065 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:48.599042 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9338fa01d9ee5659f0df90fbdc92c33e.slice/crio-0d4708123bf2d44532067aa48d53b385c29472120992a636c4ce0e38478764d4 WatchSource:0}: Error finding container 0d4708123bf2d44532067aa48d53b385c29472120992a636c4ce0e38478764d4: Status 404 returned error can't find the container with id 0d4708123bf2d44532067aa48d53b385c29472120992a636c4ce0e38478764d4 Jun 08 15:33:48.604117 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:48.604104 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 15:33:49.424282 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.424235 2553 apiserver.go:52] "Watching apiserver" Jun 08 15:33:49.434174 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.434142 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 15:33:49.434613 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.434544 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-cxql9","kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal","openshift-cluster-node-tuning-operator/tuned-czxc6","openshift-dns/node-resolver-fs5kd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal","openshift-multus/multus-srsrn","openshift-multus/network-metrics-daemon-lwcvs","openshift-ovn-kubernetes/ovnkube-node-9k4hv","kube-system/global-pull-secret-syncer-p8zzs","kube-system/konnectivity-agent-mqkgg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96","openshift-image-registry/node-ca-4vw2z","openshift-multus/multus-additional-cni-plugins-p75vr","openshift-network-diagnostics/network-check-target-jdthd"] Jun 08 15:33:49.436136 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.436112 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.436232 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.436207 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:49.437459 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.437431 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.438573 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.438551 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.439814 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.439792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.441025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.440833 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.441025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.440886 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 15:33:49.441025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.440921 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.441451 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.441236 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:49.441451 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.441311 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:33:49.441451 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.441341 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.441451 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.441392 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.442324 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442133 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.442324 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442143 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cbr48\"" Jun 08 15:33:49.442466 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442366 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nh9wl\"" Jun 08 15:33:49.442698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442523 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s597t\"" Jun 08 15:33:49.442698 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442664 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.442939 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.442922 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.444059 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.443952 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.444059 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.444010 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:49.445109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.445087 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.445727 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.445668 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 15:33:49.445833 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.445749 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vg4gg\"" Jun 08 15:33:49.445833 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.445805 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.445999 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.445870 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.446121 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.446104 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 15:33:49.447104 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.447084 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.447532 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.447457 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 15:33:49.447950 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.447929 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 15:33:49.448025 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.447958 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7nh4h\"" Jun 08 15:33:49.448501 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.448482 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.449455 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.449432 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 15:33:49.450089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.449918 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.450089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.449938 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.450089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.449943 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kx84b\"" Jun 08 15:33:49.452571 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.451787 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 15:33:49.452571 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.451846 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.452571 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.452452 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 15:33:49.453111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.452965 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t4zn7\"" Jun 08 15:33:49.453200 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.453129 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 15:33:49.453748 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.453432 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 15:33:49.453748 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.453561 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.453748 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.453588 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 15:33:49.453937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.453435 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.454920 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.454901 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l9rwt\"" Jun 08 15:33:49.455215 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.455149 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.456194 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.455833 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 15:33:49.456586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.456553 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 15:33:49.456586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.456564 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 15:33:49.458033 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.458007 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 15:33:49.458321 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.458268 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5m262\"" Jun 08 15:33:49.460124 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.460220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.460220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460160 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-script-lib\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.460220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-iptables-alerter-script\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.460220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460207 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b1c1d85-f60d-4475-b546-3b3ab361404a-hosts-file\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1c1d85-f60d-4475-b546-3b3ab361404a-tmp-dir\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-socket-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-socket-dir-parent\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460383 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqpz\" (UniqueName: \"kubernetes.io/projected/4d2c9345-0169-451c-afc0-a00eb1943114-kube-api-access-twqpz\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460449 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460474 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-registration-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460515 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-sys\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.460588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460556 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zl4b\" (UniqueName: \"kubernetes.io/projected/cbdc87c6-e342-44e2-95e2-1523c0675cd3-kube-api-access-2zl4b\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460615 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-etc-kubernetes\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cnibin\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-netd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-host-slash\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-device-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460738 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-run\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460774 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-lib-modules\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460801 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-k8s-cni-cncf-io\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-multus\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85qw\" (UniqueName: \"kubernetes.io/projected/5d121750-a152-4729-906b-4b61cbf6d248-kube-api-access-t85qw\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460893 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-multus-certs\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-etc-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460972 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-netns\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.460996 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tww\" (UniqueName: \"kubernetes.io/projected/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-kube-api-access-94tww\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.461038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461019 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-var-lib-kubelet\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461041 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-os-release\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-conf-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461130 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-dbus\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461154 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-os-release\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461177 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461226 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-systemd\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461271 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e317-494c-40dc-b863-7d6e18955ef7-konnectivity-ca\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461308 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461339 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-system-cni-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgzq\" (UniqueName: \"kubernetes.io/projected/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-kube-api-access-9sgzq\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461398 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-systemd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7zp\" (UniqueName: \"kubernetes.io/projected/1b1c1d85-f60d-4475-b546-3b3ab361404a-kube-api-access-sn7zp\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461444 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-node-log\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.461803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461487 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9xm\" (UniqueName: \"kubernetes.io/projected/fcd28f56-ce33-413d-a37b-0e447a5d1911-kube-api-access-5b9xm\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461509 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-hostroot\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461531 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-netns\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-bin\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461591 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-conf\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-tuned\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461651 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-system-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461671 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-slash\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461694 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-log-socket\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461736 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b8627d2-018b-4d40-b904-f4345434188c-ovn-node-metrics-cert\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldzj\" (UniqueName: \"kubernetes.io/projected/2b8627d2-018b-4d40-b904-f4345434188c-kube-api-access-2ldzj\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-modprobe-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461869 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysconfig\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461912 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-multus-daemon-config\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461934 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-ovn\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-tmp\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.462567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461976 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54e5e317-494c-40dc-b863-7d6e18955ef7-agent-certs\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.461997 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-cnibin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-cni-binary-copy\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-kubelet-config\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462095 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-kubelet\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462120 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-systemd-units\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462142 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-var-lib-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462169 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-env-overrides\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-sys-fs\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-host\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462238 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-etc-selinux\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462278 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-kubernetes\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-bin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462384 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-config\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.463398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462405 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.464185 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.462428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-kubelet\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.490415 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.490264 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:28:48 +0000 UTC" deadline="2028-01-15 17:39:13.122314434 +0000 UTC" Jun 08 15:33:49.490521 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.490418 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14066h5m23.631902765s" Jun 08 15:33:49.505661 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.505462 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:49.523040 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.522988 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" event={"ID":"9338fa01d9ee5659f0df90fbdc92c33e","Type":"ContainerStarted","Data":"0d4708123bf2d44532067aa48d53b385c29472120992a636c4ce0e38478764d4"} Jun 08 15:33:49.523962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.523936 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" event={"ID":"0635057a5e3034fa018046fb4304882c","Type":"ContainerStarted","Data":"f6ac6f771eee89e12da5bd5dfc25d192db2a3f127abbabce31576cee81596691"} Jun 08 15:33:49.549921 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.549890 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 15:33:49.562737 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562695 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.562871 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562746 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-systemd\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.562871 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562816 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-systemd\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.562871 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e317-494c-40dc-b863-7d6e18955ef7-konnectivity-ca\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562913 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-system-cni-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562937 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgzq\" (UniqueName: \"kubernetes.io/projected/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-kube-api-access-9sgzq\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-systemd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.562979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7zp\" (UniqueName: \"kubernetes.io/projected/1b1c1d85-f60d-4475-b546-3b3ab361404a-kube-api-access-sn7zp\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.563024 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563000 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.563281 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzj7j\" (UniqueName: \"kubernetes.io/projected/a6c46255-6957-451e-be9c-5d45a0614ecd-kube-api-access-fzj7j\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.563281 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563027 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-system-cni-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.563281 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563058 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-node-log\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.563407 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563446 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9xm\" (UniqueName: \"kubernetes.io/projected/fcd28f56-ce33-413d-a37b-0e447a5d1911-kube-api-access-5b9xm\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.563580 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563674 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-systemd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.563911 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54e5e317-494c-40dc-b863-7d6e18955ef7-konnectivity-ca\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-node-log\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564079 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.564105 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:50.064074748 +0000 UTC m=+3.004526029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564113 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-hostroot\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564158 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-netns\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564158 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-hostroot\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564216 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-netns\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564266 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-bin\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564341 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-conf\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564371 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-tuned\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564380 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-bin\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564397 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-system-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-slash\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564475 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-log-socket\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564516 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564555 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b8627d2-018b-4d40-b904-f4345434188c-ovn-node-metrics-cert\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldzj\" (UniqueName: \"kubernetes.io/projected/2b8627d2-018b-4d40-b904-f4345434188c-kube-api-access-2ldzj\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564654 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-modprobe-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysconfig\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564719 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-multus-daemon-config\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-ovn\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564788 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-tmp\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564805 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-conf\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54e5e317-494c-40dc-b863-7d6e18955ef7-agent-certs\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-cnibin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.564953 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-cni-binary-copy\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564930 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-kubelet-config\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564963 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-kubelet\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.564993 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-systemd-units\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565021 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-var-lib-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565057 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-env-overrides\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565130 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-sys-fs\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-host\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-etc-selinux\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565223 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-kubernetes\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565290 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-bin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565359 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6c46255-6957-451e-be9c-5d45a0614ecd-host\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565400 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-config\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565431 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565467 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-kubelet\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.565808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565500 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565532 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565570 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-script-lib\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565621 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-iptables-alerter-script\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565660 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565699 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b1c1d85-f60d-4475-b546-3b3ab361404a-hosts-file\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1c1d85-f60d-4475-b546-3b3ab361404a-tmp-dir\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565745 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565842 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-slash\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565899 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-log-socket\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565947 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566388 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-host\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566412 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-etc-selinux\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566448 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-kubernetes\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566484 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysconfig\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.566559 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566503 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-ovn\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.567227 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.566590 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:49.567227 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.566670 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:50.066652016 +0000 UTC m=+3.007103300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:49.567227 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566748 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-sysctl-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.567227 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.566857 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-system-cni-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.567227 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567151 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-cnibin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.567458 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567228 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-config\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.567458 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567329 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-multus-daemon-config\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.567458 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567440 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-modprobe-d\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.567658 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567578 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d2c9345-0169-451c-afc0-a00eb1943114-cni-binary-copy\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.567722 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567702 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-kubelet-config\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.565769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6c46255-6957-451e-be9c-5d45a0614ecd-serviceca\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567832 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-systemd-units\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-socket-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567890 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-var-lib-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567911 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-socket-dir-parent\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqpz\" (UniqueName: \"kubernetes.io/projected/4d2c9345-0169-451c-afc0-a00eb1943114-kube-api-access-twqpz\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567986 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-registration-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-sys\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568068 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zl4b\" (UniqueName: \"kubernetes.io/projected/cbdc87c6-e342-44e2-95e2-1523c0675cd3-kube-api-access-2zl4b\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568099 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-etc-kubernetes\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568128 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cnibin\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-netd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-host-slash\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568243 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-device-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-run\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.568335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568295 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-lib-modules\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568401 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-env-overrides\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568441 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-sys-fs\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-bin\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568623 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-kubelet\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568633 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-socket-dir-parent\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.567792 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-kubelet\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568742 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568807 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-socket-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.568841 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-run-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.569220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569129 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-sys\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.569707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569416 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.569707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-registration-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.569707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569534 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-host-cni-netd\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.569707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569572 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-host-slash\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.569707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569639 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-device-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.569959 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569746 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-etc-kubernetes\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.569959 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569776 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-run\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.569959 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569803 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cnibin\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.569959 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b8627d2-018b-4d40-b904-f4345434188c-ovnkube-script-lib\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.569909 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d121750-a152-4729-906b-4b61cbf6d248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-k8s-cni-cncf-io\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-lib-modules\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570345 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-multus\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570366 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-k8s-cni-cncf-io\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570378 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b1c1d85-f60d-4475-b546-3b3ab361404a-hosts-file\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570385 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85qw\" (UniqueName: \"kubernetes.io/projected/5d121750-a152-4729-906b-4b61cbf6d248-kube-api-access-t85qw\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570395 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-iptables-alerter-script\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570422 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-multus-certs\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570427 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-var-lib-cni-multus\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570455 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-etc-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570498 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-multus-certs\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570559 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-netns\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94tww\" (UniqueName: \"kubernetes.io/projected/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-kube-api-access-94tww\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570647 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-var-lib-kubelet\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.571268 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570669 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-os-release\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570719 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1c1d85-f60d-4475-b546-3b3ab361404a-tmp-dir\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-conf-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570679 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b8627d2-018b-4d40-b904-f4345434188c-etc-openvswitch\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570765 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-dbus\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570798 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-os-release\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570836 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbdc87c6-e342-44e2-95e2-1523c0675cd3-var-lib-kubelet\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570766 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-host-run-netns\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570947 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-os-release\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.570961 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-dbus\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.571001 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-os-release\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.571068 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d2c9345-0169-451c-afc0-a00eb1943114-multus-conf-dir\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.571229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-tmp\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.572147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.571407 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.572850 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.572481 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbdc87c6-e342-44e2-95e2-1523c0675cd3-etc-tuned\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.573167 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.573144 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgzq\" (UniqueName: \"kubernetes.io/projected/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-kube-api-access-9sgzq\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.573232 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.573176 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54e5e317-494c-40dc-b863-7d6e18955ef7-agent-certs\") pod \"konnectivity-agent-mqkgg\" (UID: \"54e5e317-494c-40dc-b863-7d6e18955ef7\") " pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.573424 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.573404 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4fa8dcb-f8eb-4bdb-b912-69784542a05c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p75vr\" (UID: \"c4fa8dcb-f8eb-4bdb-b912-69784542a05c\") " pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.574114 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.574094 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b8627d2-018b-4d40-b904-f4345434188c-ovn-node-metrics-cert\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.576083 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.576059 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7zp\" (UniqueName: \"kubernetes.io/projected/1b1c1d85-f60d-4475-b546-3b3ab361404a-kube-api-access-sn7zp\") pod \"node-resolver-fs5kd\" (UID: \"1b1c1d85-f60d-4475-b546-3b3ab361404a\") " pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.576434 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.576410 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9xm\" (UniqueName: \"kubernetes.io/projected/fcd28f56-ce33-413d-a37b-0e447a5d1911-kube-api-access-5b9xm\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:49.576962 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.576944 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:33:49.576962 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.576962 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:33:49.577110 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.576972 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:49.577110 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:49.577020 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:50.07700586 +0000 UTC m=+3.017457157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:49.579031 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.578962 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldzj\" (UniqueName: \"kubernetes.io/projected/2b8627d2-018b-4d40-b904-f4345434188c-kube-api-access-2ldzj\") pod \"ovnkube-node-9k4hv\" (UID: \"2b8627d2-018b-4d40-b904-f4345434188c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.579860 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.579842 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqpz\" (UniqueName: \"kubernetes.io/projected/4d2c9345-0169-451c-afc0-a00eb1943114-kube-api-access-twqpz\") pod \"multus-srsrn\" (UID: \"4d2c9345-0169-451c-afc0-a00eb1943114\") " pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.580388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.580367 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85qw\" (UniqueName: \"kubernetes.io/projected/5d121750-a152-4729-906b-4b61cbf6d248-kube-api-access-t85qw\") pod \"aws-ebs-csi-driver-node-52k96\" (UID: \"5d121750-a152-4729-906b-4b61cbf6d248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.580746 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.580728 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zl4b\" (UniqueName: \"kubernetes.io/projected/cbdc87c6-e342-44e2-95e2-1523c0675cd3-kube-api-access-2zl4b\") pod \"tuned-czxc6\" (UID: \"cbdc87c6-e342-44e2-95e2-1523c0675cd3\") " pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.581326 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.581309 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tww\" (UniqueName: \"kubernetes.io/projected/7c2de1e4-c92f-4b8a-81c7-b7b711f97750-kube-api-access-94tww\") pod \"iptables-alerter-cxql9\" (UID: \"7c2de1e4-c92f-4b8a-81c7-b7b711f97750\") " pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.609786 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.609760 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:33:49.671838 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.671796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzj7j\" (UniqueName: \"kubernetes.io/projected/a6c46255-6957-451e-be9c-5d45a0614ecd-kube-api-access-fzj7j\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.672013 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.671901 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6c46255-6957-451e-be9c-5d45a0614ecd-host\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.672013 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.671935 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6c46255-6957-451e-be9c-5d45a0614ecd-serviceca\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.672013 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.671998 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6c46255-6957-451e-be9c-5d45a0614ecd-host\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.672431 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.672413 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6c46255-6957-451e-be9c-5d45a0614ecd-serviceca\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.680345 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.680288 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzj7j\" (UniqueName: \"kubernetes.io/projected/a6c46255-6957-451e-be9c-5d45a0614ecd-kube-api-access-fzj7j\") pod \"node-ca-4vw2z\" (UID: \"a6c46255-6957-451e-be9c-5d45a0614ecd\") " pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:49.750301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.750260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" Jun 08 15:33:49.759907 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.759871 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czxc6" Jun 08 15:33:49.770547 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.770523 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fs5kd" Jun 08 15:33:49.776266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.776247 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srsrn" Jun 08 15:33:49.784845 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.784821 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p75vr" Jun 08 15:33:49.792570 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.792551 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:33:49.800238 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.800210 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:33:49.808888 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.808870 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxql9" Jun 08 15:33:49.815443 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:49.815424 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vw2z" Jun 08 15:33:50.074507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:50.074423 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:50.074507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:50.074505 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:50.074760 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.074563 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:50.074760 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.074584 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:50.074760 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.074644 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:51.074626441 +0000 UTC m=+4.015077721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:50.074760 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.074658 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:51.074652233 +0000 UTC m=+4.015103511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:50.175374 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:50.175342 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:50.175560 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.175509 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:33:50.175560 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.175528 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:33:50.175560 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.175537 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:50.175735 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:50.175586 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:51.175571788 +0000 UTC m=+4.116023068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:50.490961 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:50.490871 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:28:48 +0000 UTC" deadline="2028-03-12 14:51:47.2116079 +0000 UTC" Jun 08 15:33:50.490961 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:50.490919 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15431h17m56.720691897s" Jun 08 15:33:50.531056 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.530845 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1c1d85_f60d_4475_b546_3b3ab361404a.slice/crio-a3bbf7be7381e55c02fa401106e4250c510fa1a9e98f81f715907b6138aaa53a WatchSource:0}: Error finding container a3bbf7be7381e55c02fa401106e4250c510fa1a9e98f81f715907b6138aaa53a: Status 404 returned error can't find the container with id a3bbf7be7381e55c02fa401106e4250c510fa1a9e98f81f715907b6138aaa53a Jun 08 15:33:50.532110 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.532082 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbdc87c6_e342_44e2_95e2_1523c0675cd3.slice/crio-d1f32d99cfc2b572baf2455dc91db26cc228b50ee6ac0208f736feafcf579ec5 WatchSource:0}: Error finding container d1f32d99cfc2b572baf2455dc91db26cc228b50ee6ac0208f736feafcf579ec5: Status 404 returned error can't find the container with id d1f32d99cfc2b572baf2455dc91db26cc228b50ee6ac0208f736feafcf579ec5 Jun 08 15:33:50.533739 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.533699 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2c9345_0169_451c_afc0_a00eb1943114.slice/crio-9aa31c4fab6ce33b4c7cc0a26a5fa95f3b7f072ddbad78bf7a6339716a366814 WatchSource:0}: Error finding container 9aa31c4fab6ce33b4c7cc0a26a5fa95f3b7f072ddbad78bf7a6339716a366814: Status 404 returned error can't find the container with id 9aa31c4fab6ce33b4c7cc0a26a5fa95f3b7f072ddbad78bf7a6339716a366814 Jun 08 15:33:50.537461 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.537067 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d121750_a152_4729_906b_4b61cbf6d248.slice/crio-4f3864ff1bd50db3d97de386915a7ccec75eba8a1cef6e8075a053970d859b13 WatchSource:0}: Error finding container 4f3864ff1bd50db3d97de386915a7ccec75eba8a1cef6e8075a053970d859b13: Status 404 returned error can't find the container with id 4f3864ff1bd50db3d97de386915a7ccec75eba8a1cef6e8075a053970d859b13 Jun 08 15:33:50.538283 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.538267 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fa8dcb_f8eb_4bdb_b912_69784542a05c.slice/crio-2a97bfc2497a5bb4a91b14d736cf37796c9312d1137412f667d88457f476f382 WatchSource:0}: Error finding container 2a97bfc2497a5bb4a91b14d736cf37796c9312d1137412f667d88457f476f382: Status 404 returned error can't find the container with id 2a97bfc2497a5bb4a91b14d736cf37796c9312d1137412f667d88457f476f382 Jun 08 15:33:50.539926 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.539840 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8627d2_018b_4d40_b904_f4345434188c.slice/crio-1b01ddf51476757081105a1a97100a05bfe5179d69caccce1ccadecccae0cf49 WatchSource:0}: Error finding container 1b01ddf51476757081105a1a97100a05bfe5179d69caccce1ccadecccae0cf49: Status 404 returned error can't find the container with id 1b01ddf51476757081105a1a97100a05bfe5179d69caccce1ccadecccae0cf49 Jun 08 15:33:50.540738 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.540718 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e5e317_494c_40dc_b863_7d6e18955ef7.slice/crio-db2714cfbfa0884de1b0ceda0adf4b21610334c989c8465ae0d17382c0b08438 WatchSource:0}: Error finding container db2714cfbfa0884de1b0ceda0adf4b21610334c989c8465ae0d17382c0b08438: Status 404 returned error can't find the container with id db2714cfbfa0884de1b0ceda0adf4b21610334c989c8465ae0d17382c0b08438 Jun 08 15:33:50.541862 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.541455 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2de1e4_c92f_4b8a_81c7_b7b711f97750.slice/crio-2d67c85e7dd1384f6204c486658e08be3537762a9b4d4ee874856abead3dc4db WatchSource:0}: Error finding container 2d67c85e7dd1384f6204c486658e08be3537762a9b4d4ee874856abead3dc4db: Status 404 returned error can't find the container with id 2d67c85e7dd1384f6204c486658e08be3537762a9b4d4ee874856abead3dc4db Jun 08 15:33:50.543040 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:33:50.542892 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c46255_6957_451e_be9c_5d45a0614ecd.slice/crio-dbe8ccff20e9a9d092ebead383a9c08d97a5550c6c6e0bea707c514414426e75 WatchSource:0}: Error finding container dbe8ccff20e9a9d092ebead383a9c08d97a5550c6c6e0bea707c514414426e75: Status 404 returned error can't find the container with id dbe8ccff20e9a9d092ebead383a9c08d97a5550c6c6e0bea707c514414426e75 Jun 08 15:33:51.081926 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.081798 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:51.081926 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.081890 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:51.082176 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.082042 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:51.082176 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.082108 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:53.082088647 +0000 UTC m=+6.022539925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:51.082284 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.082177 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:51.082284 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.082212 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:53.082200166 +0000 UTC m=+6.022651440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:51.182614 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.182561 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:51.182801 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.182761 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:33:51.182801 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.182780 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:33:51.182801 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.182792 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:51.182948 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.182850 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:53.182830827 +0000 UTC m=+6.123282104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:51.520859 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.520319 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:51.520859 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.520436 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:33:51.520859 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.520703 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:51.520859 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.520820 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:51.521879 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.521728 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:51.521879 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:51.521830 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:51.538338 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.538238 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" event={"ID":"5d121750-a152-4729-906b-4b61cbf6d248","Type":"ContainerStarted","Data":"4f3864ff1bd50db3d97de386915a7ccec75eba8a1cef6e8075a053970d859b13"} Jun 08 15:33:51.549750 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.549718 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srsrn" event={"ID":"4d2c9345-0169-451c-afc0-a00eb1943114","Type":"ContainerStarted","Data":"9aa31c4fab6ce33b4c7cc0a26a5fa95f3b7f072ddbad78bf7a6339716a366814"} Jun 08 15:33:51.555772 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.555692 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czxc6" event={"ID":"cbdc87c6-e342-44e2-95e2-1523c0675cd3","Type":"ContainerStarted","Data":"d1f32d99cfc2b572baf2455dc91db26cc228b50ee6ac0208f736feafcf579ec5"} Jun 08 15:33:51.570083 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.570046 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" event={"ID":"9338fa01d9ee5659f0df90fbdc92c33e","Type":"ContainerStarted","Data":"4ba25094267109123a74729040695fce84cafa6d12024fbbb371fb9519e41a6a"} Jun 08 15:33:51.577266 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.577222 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"1b01ddf51476757081105a1a97100a05bfe5179d69caccce1ccadecccae0cf49"} Jun 08 15:33:51.582454 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.582421 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fs5kd" event={"ID":"1b1c1d85-f60d-4475-b546-3b3ab361404a","Type":"ContainerStarted","Data":"a3bbf7be7381e55c02fa401106e4250c510fa1a9e98f81f715907b6138aaa53a"} Jun 08 15:33:51.584432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.584375 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-19.ec2.internal" podStartSLOduration=3.584356729 podStartE2EDuration="3.584356729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:33:51.584127598 +0000 UTC m=+4.524578895" watchObservedRunningTime="2026-06-08 15:33:51.584356729 +0000 UTC m=+4.524808026" Jun 08 15:33:51.596004 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.595966 2553 generic.go:356] "Generic (PLEG): container finished" podID="0635057a5e3034fa018046fb4304882c" containerID="3c816bc855108b22a9641ba0f785b7dab4814897de070072e41481fc1eabc8cf" exitCode=0 Jun 08 15:33:51.596319 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.596287 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" event={"ID":"0635057a5e3034fa018046fb4304882c","Type":"ContainerDied","Data":"3c816bc855108b22a9641ba0f785b7dab4814897de070072e41481fc1eabc8cf"} Jun 08 15:33:51.615204 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.615129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vw2z" event={"ID":"a6c46255-6957-451e-be9c-5d45a0614ecd","Type":"ContainerStarted","Data":"dbe8ccff20e9a9d092ebead383a9c08d97a5550c6c6e0bea707c514414426e75"} Jun 08 15:33:51.621066 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.621035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxql9" event={"ID":"7c2de1e4-c92f-4b8a-81c7-b7b711f97750","Type":"ContainerStarted","Data":"2d67c85e7dd1384f6204c486658e08be3537762a9b4d4ee874856abead3dc4db"} Jun 08 15:33:51.631158 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.631123 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqkgg" event={"ID":"54e5e317-494c-40dc-b863-7d6e18955ef7","Type":"ContainerStarted","Data":"db2714cfbfa0884de1b0ceda0adf4b21610334c989c8465ae0d17382c0b08438"} Jun 08 15:33:51.636923 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:51.636891 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerStarted","Data":"2a97bfc2497a5bb4a91b14d736cf37796c9312d1137412f667d88457f476f382"} Jun 08 15:33:52.656996 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:52.656961 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" event={"ID":"0635057a5e3034fa018046fb4304882c","Type":"ContainerStarted","Data":"41766d3306bc6bf3038ed2bda3129c98a8d6c5d0fa989dee5e1ac366970b0515"} Jun 08 15:33:52.673366 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:52.673308 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-19.ec2.internal" podStartSLOduration=4.673285663 podStartE2EDuration="4.673285663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:33:52.672704772 +0000 UTC m=+5.613156064" watchObservedRunningTime="2026-06-08 15:33:52.673285663 +0000 UTC m=+5.613736960" Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.098275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.098359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.098475 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.098534 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:57.09851662 +0000 UTC m=+10.038967898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.098972 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:53.099124 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.099035 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:57.099019492 +0000 UTC m=+10.039470765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:53.199369 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.198709 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:53.199369 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.198928 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:33:53.199369 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.198950 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:33:53.199369 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.198963 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:53.199369 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.199031 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:33:57.19900076 +0000 UTC m=+10.139452048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:53.519685 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.519330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:53.519685 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.519378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:53.519685 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.519458 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:33:53.519685 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.519519 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:53.519685 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:53.519667 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:53.520060 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:53.519758 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:55.519054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:55.519016 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:55.519504 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:55.519152 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:55.519504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:55.519249 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:55.519504 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:55.519408 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:55.519504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:55.519464 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:55.519733 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:55.519534 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:33:57.138271 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.138230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:57.138805 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.138324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:57.138805 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.138435 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:57.138805 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.138513 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:05.138493839 +0000 UTC m=+18.078945127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:33:57.138805 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.138440 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:57.138805 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.138565 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:05.138552801 +0000 UTC m=+18.079004079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:33:57.239460 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.238998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:57.240695 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.240659 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:33:57.240797 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.240705 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:33:57.240797 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.240719 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:57.240797 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.240791 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:05.240770546 +0000 UTC m=+18.181221840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.519771 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.519880 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.519907 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.519984 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:57.520035 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:57.520260 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:57.520108 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:59.519641 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:59.519585 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:33:59.520151 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:59.519655 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:33:59.520151 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:33:59.519585 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:33:59.520151 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:59.519741 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:33:59.520151 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:59.519883 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:33:59.520151 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:33:59.519953 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:01.519614 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:01.519562 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:01.520129 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:01.519562 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:01.520129 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:01.519722 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:01.520129 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:01.519780 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:01.520129 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:01.519573 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:01.520129 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:01.519862 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:03.519054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:03.519014 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:03.519054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:03.519054 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:03.519508 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:03.519013 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:03.519508 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:03.519155 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:03.519508 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:03.519221 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:03.519508 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:03.519278 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:05.204204 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.204160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:05.204700 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.204240 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:05.204700 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.204330 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:34:05.204700 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.204393 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:21.204376773 +0000 UTC m=+34.144828050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:34:05.204700 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.204332 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:34:05.204700 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.204437 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:21.204427268 +0000 UTC m=+34.144878552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:34:05.305106 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.305063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:05.305275 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.305211 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:34:05.305275 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.305234 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:34:05.305275 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.305245 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:34:05.305444 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.305302 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:21.305288165 +0000 UTC m=+34.245739439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:34:05.519541 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.519503 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:05.519733 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.519503 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:05.519733 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.519652 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:05.519733 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:05.519523 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:05.519733 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.519706 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:05.519969 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:05.519808 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:07.520132 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:07.520091 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:07.520609 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:07.520193 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:07.520609 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:07.520241 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:07.520609 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:07.520264 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:07.520609 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:07.520289 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:07.520609 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:07.520374 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:09.519776 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.519591 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:09.520257 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.519591 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:09.520257 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:09.519867 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:09.520257 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:09.519951 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:09.520257 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.519628 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:09.520257 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:09.520053 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:09.695840 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.695795 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vw2z" event={"ID":"a6c46255-6957-451e-be9c-5d45a0614ecd","Type":"ContainerStarted","Data":"478ecc55d41626eeb3e62d9dde768eea1be809f1c8d997a4f23e3a28d5dc48ab"} Jun 08 15:34:09.697483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.697436 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqkgg" event={"ID":"54e5e317-494c-40dc-b863-7d6e18955ef7","Type":"ContainerStarted","Data":"a16a0cd99ae31b6cf271e9e2c50ffaadf4f7e7d39125af9a4243df1a2585ef8c"} Jun 08 15:34:09.699428 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.699398 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="0e5fac001dbfefedd64ca642c6039b2bf5b3a328ddbb5fd5845dc471bdf59fcd" exitCode=0 Jun 08 15:34:09.699547 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.699481 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"0e5fac001dbfefedd64ca642c6039b2bf5b3a328ddbb5fd5845dc471bdf59fcd"} Jun 08 15:34:09.701295 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.701226 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" event={"ID":"5d121750-a152-4729-906b-4b61cbf6d248","Type":"ContainerStarted","Data":"cf77b2940bb8f8f86372ac164241eabc43ef70f713abcb55cd65cea763a8b8a7"} Jun 08 15:34:09.702945 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.702921 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srsrn" event={"ID":"4d2c9345-0169-451c-afc0-a00eb1943114","Type":"ContainerStarted","Data":"b4c82e6e80707139e6e9689cd5278c211b53c944dfab79f0511ff1ad98c9a721"} Jun 08 15:34:09.704744 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.704716 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czxc6" event={"ID":"cbdc87c6-e342-44e2-95e2-1523c0675cd3","Type":"ContainerStarted","Data":"f6b3b344067a976d7097ff8364e89bf2ccf6bf57c812c89d67e5c43483ac0d2e"} Jun 08 15:34:09.708405 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.708377 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:34:09.708852 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.708826 2553 generic.go:356] "Generic (PLEG): container finished" podID="2b8627d2-018b-4d40-b904-f4345434188c" containerID="49e5bb9f71eca6700060af5f55c788dbb40eec203c5b5acf59efe4bfd5dcc7ed" exitCode=1 Jun 08 15:34:09.708950 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.708888 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"c9a5597e5b9957cc63597160234bd5762e48e2449ab35b5f8a66225051a82559"} Jun 08 15:34:09.709003 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.708977 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"b8a8fdf8083a654463daae5f13db6689b171b6293c1360a1243df1341c32679e"} Jun 08 15:34:09.709049 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.709028 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"90818e6d49bd2782ffd1c4b88126fe2b8c02544268d622ff50401585454dd4fd"} Jun 08 15:34:09.709097 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.709078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"21eaff364f1aa0abe9e3c1d01703505fe8ca0d702b8a880b9051ae47e2887c0f"} Jun 08 15:34:09.709168 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.709125 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerDied","Data":"49e5bb9f71eca6700060af5f55c788dbb40eec203c5b5acf59efe4bfd5dcc7ed"} Jun 08 15:34:09.709272 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.709205 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"b705d90ee46f127dc846dd07eabe80dc216f82ae85188228a934d2a87d5db3a5"} Jun 08 15:34:09.710171 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.710129 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4vw2z" podStartSLOduration=4.412267622 podStartE2EDuration="22.710115907s" totalImagesPullingTime="18.297848285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:09.709654895 +0000 UTC m=+22.650106192" watchObservedRunningTime="2026-06-08 15:34:09.710115907 +0000 UTC m=+22.650567202" Jun 08 15:34:09.710482 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.710462 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fs5kd" event={"ID":"1b1c1d85-f60d-4475-b546-3b3ab361404a","Type":"ContainerStarted","Data":"9d46c70247fd27330cfb679fcc3ae120a3b10ba02eccc2287ad293af22ccc838"} Jun 08 15:34:09.728676 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.728630 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-srsrn" podStartSLOduration=4.379942682 podStartE2EDuration="22.728610672s" totalImagesPullingTime="18.34866799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:09.728463956 +0000 UTC m=+22.668915262" watchObservedRunningTime="2026-06-08 15:34:09.728610672 +0000 UTC m=+22.669061960" Jun 08 15:34:09.764061 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.764012 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mqkgg" podStartSLOduration=8.919040217 podStartE2EDuration="22.763995927s" totalImagesPullingTime="13.84495571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:09.76332387 +0000 UTC m=+22.703775188" watchObservedRunningTime="2026-06-08 15:34:09.763995927 +0000 UTC m=+22.704447222" Jun 08 15:34:09.780420 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.780362 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-czxc6" podStartSLOduration=4.470306245 podStartE2EDuration="22.780347979s" totalImagesPullingTime="18.310041734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:09.779952833 +0000 UTC m=+22.720404131" watchObservedRunningTime="2026-06-08 15:34:09.780347979 +0000 UTC m=+22.720799306" Jun 08 15:34:09.794796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:09.794749 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fs5kd" podStartSLOduration=4.484993675 podStartE2EDuration="22.794734439s" totalImagesPullingTime="18.309740764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:09.794248068 +0000 UTC m=+22.734699364" watchObservedRunningTime="2026-06-08 15:34:09.794734439 +0000 UTC m=+22.735185734" Jun 08 15:34:10.498444 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.498411 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 15:34:10.517442 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.517352 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T15:34:10.498438202Z","UUID":"abc011a3-d6d8-4379-b7b7-4ce498584aeb","Handler":null,"Name":"","Endpoint":""} Jun 08 15:34:10.518907 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.518886 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 15:34:10.519036 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.518925 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 15:34:10.714665 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.714564 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" event={"ID":"5d121750-a152-4729-906b-4b61cbf6d248","Type":"ContainerStarted","Data":"4888173b3e489fe93d517578944b49b835d07c826ed97709adc825784f619583"} Jun 08 15:34:10.716288 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.716223 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxql9" event={"ID":"7c2de1e4-c92f-4b8a-81c7-b7b711f97750","Type":"ContainerStarted","Data":"048f8acfd57f4ecaf8359e023eb042753d270b48c90f299bd546c03505fff9bd"} Jun 08 15:34:10.730693 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:10.730636 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cxql9" podStartSLOduration=5.431390235 podStartE2EDuration="23.730617498s" totalImagesPullingTime="18.299227263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:10.730452939 +0000 UTC m=+23.670904237" watchObservedRunningTime="2026-06-08 15:34:10.730617498 +0000 UTC m=+23.671068795" Jun 08 15:34:11.031144 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.031106 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:34:11.031852 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.031831 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:34:11.518899 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.518873 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:11.519053 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.518885 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:11.519053 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:11.519037 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:11.519169 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:11.519116 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:11.519224 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.519182 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:11.519283 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:11.519260 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:11.720839 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.720804 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" event={"ID":"5d121750-a152-4729-906b-4b61cbf6d248","Type":"ContainerStarted","Data":"44ee8015dcd74952f70b685c7cff7937fba28f40fc72805580e208b3d34c8e18"} Jun 08 15:34:11.740070 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.739851 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:34:11.740342 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.740183 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mqkgg" Jun 08 15:34:11.756570 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:11.756523 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52k96" podStartSLOduration=4.380538577 podStartE2EDuration="24.756505145s" totalImagesPullingTime="20.375966568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:11.756408582 +0000 UTC m=+24.696859879" watchObservedRunningTime="2026-06-08 15:34:11.756505145 +0000 UTC m=+24.696956441" Jun 08 15:34:12.726402 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:12.726147 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:34:12.726852 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:12.726804 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"348e4faa637844a7965757d12d0cbb42e8cdc9fa347240c5efb8dc6bf5838e29"} Jun 08 15:34:13.519478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:13.519440 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:13.519478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:13.519472 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:13.519478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:13.519440 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:13.519815 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:13.519573 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:13.519815 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:13.519657 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:13.519815 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:13.519758 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:14.734301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.734271 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:34:14.734719 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.734668 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"9205c2fa2e4ad5d30dd9bdfefb63a256b7ff80e2f3dcdc2e72b245841a385aa3"} Jun 08 15:34:14.735026 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.734939 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:14.735026 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.735027 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:14.735195 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.735130 2553 scope.go:117] "RemoveContainer" containerID="49e5bb9f71eca6700060af5f55c788dbb40eec203c5b5acf59efe4bfd5dcc7ed" Jun 08 15:34:14.736932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.736905 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="dded06364bb721abe8c50936f4322bac2ad573a0986fb9542b6b26207ff61740" exitCode=0 Jun 08 15:34:14.737043 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.736951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"dded06364bb721abe8c50936f4322bac2ad573a0986fb9542b6b26207ff61740"} Jun 08 15:34:14.751655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.751453 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:14.752565 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:14.752546 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:15.228162 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.228028 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:15.519556 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.519529 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:15.519715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.519529 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:15.519715 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:15.519653 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:15.519715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.519706 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:15.519817 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:15.519791 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:15.519901 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:15.519880 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:15.743564 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.743544 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:34:15.744094 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.744074 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" event={"ID":"2b8627d2-018b-4d40-b904-f4345434188c","Type":"ContainerStarted","Data":"dd2c96d4b8cb81350a2ba3925e4a416394944c5daca7cc6bdce9a2f366ba0678"} Jun 08 15:34:15.784163 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:15.783890 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" podStartSLOduration=10.213230553 podStartE2EDuration="28.783868414s" totalImagesPullingTime="18.570637861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:15.780656401 +0000 UTC m=+28.721107700" watchObservedRunningTime="2026-06-08 15:34:15.783868414 +0000 UTC m=+28.724319711" Jun 08 15:34:16.148293 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.148202 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8zzs"] Jun 08 15:34:16.148424 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.148349 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:16.148469 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:16.148440 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:16.152187 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.151938 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdthd"] Jun 08 15:34:16.152187 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.152052 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:16.152187 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:16.152138 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:16.152771 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.152736 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwcvs"] Jun 08 15:34:16.152868 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.152856 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:16.152983 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:16.152962 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:16.748687 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.748656 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="d5f220913a65044ff584812ffdde00e49dbef2c4f02b95a7a35445ce0c97a38e" exitCode=0 Jun 08 15:34:16.749243 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:16.748745 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"d5f220913a65044ff584812ffdde00e49dbef2c4f02b95a7a35445ce0c97a38e"} Jun 08 15:34:17.519773 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:17.519740 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:17.519916 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:17.519853 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:17.519916 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:17.519897 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:17.520054 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:17.519987 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:17.520054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:17.520035 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:17.520171 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:17.520148 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:18.754669 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:18.754374 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="3263eb028ffca19da5e9604edf7fd23c594e84be765c8ddc186f0c805347a146" exitCode=0 Jun 08 15:34:18.755126 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:18.754458 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"3263eb028ffca19da5e9604edf7fd23c594e84be765c8ddc186f0c805347a146"} Jun 08 15:34:19.519869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:19.519834 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:19.520042 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:19.519871 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:19.520042 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:19.519840 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:19.520042 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:19.519966 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:19.520358 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:19.520275 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:19.520477 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:19.520365 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:21.220910 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.220873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:21.221390 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.220936 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:21.221390 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.221019 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:34:21.221390 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.221033 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:34:21.221390 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.221080 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret podName:2ea0fbd1-bc8c-4c89-a626-b1cbb0858764 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:53.221064536 +0000 UTC m=+66.161515814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret") pod "global-pull-secret-syncer-p8zzs" (UID: "2ea0fbd1-bc8c-4c89-a626-b1cbb0858764") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:34:21.221390 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.221096 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:53.221088001 +0000 UTC m=+66.161539275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:34:21.322108 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.322076 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:21.322276 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.322231 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:34:21.322276 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.322248 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:34:21.322276 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.322260 2553 projected.go:196] Error preparing data for projected volume kube-api-access-f7hgd for pod openshift-network-diagnostics/network-check-target-jdthd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:34:21.322387 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.322312 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd podName:f2b30f80-2bff-4443-9f2b-edac05778712 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:53.32229719 +0000 UTC m=+66.262748464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7hgd" (UniqueName: "kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd") pod "network-check-target-jdthd" (UID: "f2b30f80-2bff-4443-9f2b-edac05778712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:34:21.519414 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.519385 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:21.519647 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.519385 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:21.519647 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.519525 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:34:21.519647 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.519584 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdthd" podUID="f2b30f80-2bff-4443-9f2b-edac05778712" Jun 08 15:34:21.519647 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.519389 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:21.519943 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:21.519696 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p8zzs" podUID="2ea0fbd1-bc8c-4c89-a626-b1cbb0858764" Jun 08 15:34:21.921967 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.921894 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-19.ec2.internal" event="NodeReady" Jun 08 15:34:21.922109 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.922021 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 15:34:21.967040 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.966997 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-prmb9"] Jun 08 15:34:21.983940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.983916 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xm5c4"] Jun 08 15:34:21.984111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.984064 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:21.987054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.987032 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 15:34:21.987054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.987029 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 15:34:21.987252 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.987133 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p7nwf\"" Jun 08 15:34:21.998115 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.998093 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-prmb9"] Jun 08 15:34:21.998219 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.998135 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm5c4"] Jun 08 15:34:21.998219 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:21.998210 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.001293 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.001148 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 15:34:22.001293 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.001226 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 15:34:22.001293 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.001258 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 15:34:22.001543 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.001525 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nvn49\"" Jun 08 15:34:22.128808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128778 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-config-volume\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.128990 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128824 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-tmp-dir\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.128990 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128874 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62cwl\" (UniqueName: \"kubernetes.io/projected/a80a72fe-4a8c-430b-bb45-6afcafdc345d-kube-api-access-62cwl\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.128990 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.128990 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xct\" (UniqueName: \"kubernetes.io/projected/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-kube-api-access-k9xct\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.128990 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.128956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80a72fe-4a8c-430b-bb45-6afcafdc345d-cert\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.229890 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.229795 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.229890 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.229855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xct\" (UniqueName: \"kubernetes.io/projected/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-kube-api-access-k9xct\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.229890 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.229880 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80a72fe-4a8c-430b-bb45-6afcafdc345d-cert\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.230388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.229904 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-config-volume\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.230388 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:22.229953 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:22.230388 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:22.230028 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:22.730005422 +0000 UTC m=+35.670456716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:22.230388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.229958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-tmp-dir\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.230388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.230146 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62cwl\" (UniqueName: \"kubernetes.io/projected/a80a72fe-4a8c-430b-bb45-6afcafdc345d-kube-api-access-62cwl\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.234851 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.234832 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80a72fe-4a8c-430b-bb45-6afcafdc345d-cert\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.237487 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.237463 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-tmp-dir\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.237732 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.237705 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-config-volume\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.239071 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.239042 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xct\" (UniqueName: \"kubernetes.io/projected/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-kube-api-access-k9xct\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.239382 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.239339 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62cwl\" (UniqueName: \"kubernetes.io/projected/a80a72fe-4a8c-430b-bb45-6afcafdc345d-kube-api-access-62cwl\") pod \"ingress-canary-xm5c4\" (UID: \"a80a72fe-4a8c-430b-bb45-6afcafdc345d\") " pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.308900 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.308828 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm5c4" Jun 08 15:34:22.481527 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.481142 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm5c4"] Jun 08 15:34:22.733615 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:22.733512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:22.733763 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:22.733700 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:22.733830 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:22.733775 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:23.73375837 +0000 UTC m=+36.674209644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:23.413981 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.413950 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47"] Jun 08 15:34:23.416513 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.416484 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.419670 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.419633 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 15:34:23.419670 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.419655 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 15:34:23.419863 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.419633 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 15:34:23.420877 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.420859 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 15:34:23.420983 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.420884 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4wwqp\"" Jun 08 15:34:23.422015 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.421996 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g"] Jun 08 15:34:23.423880 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.423818 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.427149 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.427128 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 15:34:23.427537 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.427359 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 15:34:23.427537 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.427426 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47"] Jun 08 15:34:23.427537 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.427442 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 15:34:23.427537 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.427451 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 15:34:23.435769 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.435742 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g"] Jun 08 15:34:23.519898 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.519855 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:23.520081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.519906 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:23.520081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.519855 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.523361 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.523435 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54ltp\"" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.523555 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.523708 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.523878 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 15:34:23.525290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.524125 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ld5bv\"" Jun 08 15:34:23.540690 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ea30ef0-0abe-45b0-9faa-87228a91cf23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.540690 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540690 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.540876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540739 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vrh\" (UniqueName: \"kubernetes.io/projected/188d057c-f7d5-494a-96e2-0a82b428d10c-kube-api-access-g8vrh\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.540876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540782 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d057c-f7d5-494a-96e2-0a82b428d10c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.540876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540835 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgmt\" (UniqueName: \"kubernetes.io/projected/2ea30ef0-0abe-45b0-9faa-87228a91cf23-kube-api-access-mlgmt\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.540876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540860 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.541143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.541143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.540990 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642382 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ea30ef0-0abe-45b0-9faa-87228a91cf23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.642433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642433 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vrh\" (UniqueName: \"kubernetes.io/projected/188d057c-f7d5-494a-96e2-0a82b428d10c-kube-api-access-g8vrh\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642505 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d057c-f7d5-494a-96e2-0a82b428d10c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgmt\" (UniqueName: \"kubernetes.io/projected/2ea30ef0-0abe-45b0-9faa-87228a91cf23-kube-api-access-mlgmt\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.642717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642666 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642891 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642739 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.642891 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.642768 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.643517 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.643469 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d057c-f7d5-494a-96e2-0a82b428d10c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.646758 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.646734 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.646758 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.646746 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-hub\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.646910 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.646805 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ea30ef0-0abe-45b0-9faa-87228a91cf23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.647299 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.647260 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-ca\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.647779 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.647754 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/188d057c-f7d5-494a-96e2-0a82b428d10c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.652000 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.651976 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgmt\" (UniqueName: \"kubernetes.io/projected/2ea30ef0-0abe-45b0-9faa-87228a91cf23-kube-api-access-mlgmt\") pod \"managed-serviceaccount-addon-agent-8545868bb8-jgm47\" (UID: \"2ea30ef0-0abe-45b0-9faa-87228a91cf23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.652157 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.652107 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vrh\" (UniqueName: \"kubernetes.io/projected/188d057c-f7d5-494a-96e2-0a82b428d10c-kube-api-access-g8vrh\") pod \"cluster-proxy-proxy-agent-7b5bc48f9d-62t2g\" (UID: \"188d057c-f7d5-494a-96e2-0a82b428d10c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.735260 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.735165 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:34:23.743744 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.743715 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:34:23.743913 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:23.743890 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:23.744076 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:23.744055 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:23.744155 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:23.744143 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:25.744125581 +0000 UTC m=+38.684576859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:23.994963 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:34:23.994686 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80a72fe_4a8c_430b_bb45_6afcafdc345d.slice/crio-a697ccdeac2d672bc129e22093b0fb47d7f6dcf9263de423c1b9a1235fece83a WatchSource:0}: Error finding container a697ccdeac2d672bc129e22093b0fb47d7f6dcf9263de423c1b9a1235fece83a: Status 404 returned error can't find the container with id a697ccdeac2d672bc129e22093b0fb47d7f6dcf9263de423c1b9a1235fece83a Jun 08 15:34:24.132999 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.132976 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47"] Jun 08 15:34:24.135358 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:34:24.135329 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea30ef0_0abe_45b0_9faa_87228a91cf23.slice/crio-5341569a003d74f19057b8103dbd37a8ecf7b2678239d02b9a2bb3ede7f5466d WatchSource:0}: Error finding container 5341569a003d74f19057b8103dbd37a8ecf7b2678239d02b9a2bb3ede7f5466d: Status 404 returned error can't find the container with id 5341569a003d74f19057b8103dbd37a8ecf7b2678239d02b9a2bb3ede7f5466d Jun 08 15:34:24.138808 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.138786 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g"] Jun 08 15:34:24.143032 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:34:24.143005 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod188d057c_f7d5_494a_96e2_0a82b428d10c.slice/crio-219cbadce3fe3c9c54be9a000ee85d1b8f3f2257507da615b3f76e138c9f4380 WatchSource:0}: Error finding container 219cbadce3fe3c9c54be9a000ee85d1b8f3f2257507da615b3f76e138c9f4380: Status 404 returned error can't find the container with id 219cbadce3fe3c9c54be9a000ee85d1b8f3f2257507da615b3f76e138c9f4380 Jun 08 15:34:24.770772 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.770727 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerStarted","Data":"219cbadce3fe3c9c54be9a000ee85d1b8f3f2257507da615b3f76e138c9f4380"} Jun 08 15:34:24.772187 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.772136 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerStarted","Data":"5341569a003d74f19057b8103dbd37a8ecf7b2678239d02b9a2bb3ede7f5466d"} Jun 08 15:34:24.773570 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.773506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm5c4" event={"ID":"a80a72fe-4a8c-430b-bb45-6afcafdc345d","Type":"ContainerStarted","Data":"a697ccdeac2d672bc129e22093b0fb47d7f6dcf9263de423c1b9a1235fece83a"} Jun 08 15:34:24.777720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.777661 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="f2201b314bb7e0e5504ac6ac048421b6835eaec1991b66da6c90d47fa1c552ef" exitCode=0 Jun 08 15:34:24.777720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:24.777707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"f2201b314bb7e0e5504ac6ac048421b6835eaec1991b66da6c90d47fa1c552ef"} Jun 08 15:34:25.761415 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:25.760783 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:25.761415 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:25.760935 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:25.761415 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:25.761000 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:29.760980262 +0000 UTC m=+42.701431559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:25.786391 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:25.786355 2553 generic.go:356] "Generic (PLEG): container finished" podID="c4fa8dcb-f8eb-4bdb-b912-69784542a05c" containerID="fd7c8653dff009aa44661e6480fad3ebe9e7bc8994a1d01e0953c7756edf2a93" exitCode=0 Jun 08 15:34:25.787079 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:25.786433 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerDied","Data":"fd7c8653dff009aa44661e6480fad3ebe9e7bc8994a1d01e0953c7756edf2a93"} Jun 08 15:34:26.793368 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:26.793321 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p75vr" event={"ID":"c4fa8dcb-f8eb-4bdb-b912-69784542a05c","Type":"ContainerStarted","Data":"096f638f3518b8d2a5d4350ffae7b6ab1842792a67c76b5ea5de139d4f353fae"} Jun 08 15:34:26.818100 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:26.818038 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p75vr" podStartSLOduration=9.872959705 podStartE2EDuration="39.818015236s" totalImagesPullingTime="29.945055531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:26.815833593 +0000 UTC m=+39.756284914" watchObservedRunningTime="2026-06-08 15:34:26.818015236 +0000 UTC m=+39.758466534" Jun 08 15:34:29.794190 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:29.794166 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:29.794553 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:29.794309 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:29.794553 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:29.794363 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:37.794347152 +0000 UTC m=+50.734798426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:30.805585 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.805548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerStarted","Data":"4964d2d34756ee2ba52ca51aaa20816335698053a2c0a677d82267d3602061ce"} Jun 08 15:34:30.806056 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.805610 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerStarted","Data":"eb35f751aed3d63087cae2bf741d8f4fc7dc8f614296d9bd31f2da358c7e6edd"} Jun 08 15:34:30.806056 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.805629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerStarted","Data":"713bbe9d915f9be27c8ccbde9734477dc7bced873d08fc343053e316a9db29e0"} Jun 08 15:34:30.806930 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.806904 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerStarted","Data":"30209e8128ea169b4aa23aeb1b7d7e5edec5db90621a1de70b371e970da4cb1b"} Jun 08 15:34:30.808245 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.808222 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm5c4" event={"ID":"a80a72fe-4a8c-430b-bb45-6afcafdc345d","Type":"ContainerStarted","Data":"c9aaaff111652d17645b15929f98495226d857d56d2be574f363b718fc29404c"} Jun 08 15:34:30.825057 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.825005 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" podStartSLOduration=2.172673257 podStartE2EDuration="7.824990159s" totalImagesPullingTime="5.652316902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:30.823589585 +0000 UTC m=+43.764040883" watchObservedRunningTime="2026-06-08 15:34:30.824990159 +0000 UTC m=+43.765441455" Jun 08 15:34:30.839233 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.839177 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xm5c4" podStartSLOduration=4.056930374 podStartE2EDuration="9.83915802s" totalImagesPullingTime="5.782227646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:30.839123969 +0000 UTC m=+43.779575269" watchObservedRunningTime="2026-06-08 15:34:30.83915802 +0000 UTC m=+43.779609321" Jun 08 15:34:30.854794 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:30.854744 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" podStartSLOduration=2.201183088 podStartE2EDuration="7.854726798s" totalImagesPullingTime="5.65354371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:30.853806986 +0000 UTC m=+43.794258282" watchObservedRunningTime="2026-06-08 15:34:30.854726798 +0000 UTC m=+43.795178094" Jun 08 15:34:37.850392 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:37.850354 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:37.850930 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:37.850468 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:37.850930 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:37.850531 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:34:53.850515809 +0000 UTC m=+66.790967084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:46.767645 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:46.767612 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k4hv" Jun 08 15:34:53.260307 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.260264 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:34:53.260771 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.260320 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:53.263361 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.263345 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 15:34:53.263436 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.263349 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 15:34:53.270811 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:53.270792 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 15:34:53.270939 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:53.270873 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:35:57.270852145 +0000 UTC m=+130.211303432 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : secret "metrics-daemon-secret" not found Jun 08 15:34:53.273367 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.273351 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ea0fbd1-bc8c-4c89-a626-b1cbb0858764-original-pull-secret\") pod \"global-pull-secret-syncer-p8zzs\" (UID: \"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764\") " pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:53.360822 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.360776 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:53.364018 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.363996 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 15:34:53.374529 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.374506 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 15:34:53.384156 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.384136 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hgd\" (UniqueName: \"kubernetes.io/projected/f2b30f80-2bff-4443-9f2b-edac05778712-kube-api-access-f7hgd\") pod \"network-check-target-jdthd\" (UID: \"f2b30f80-2bff-4443-9f2b-edac05778712\") " pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:53.544422 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.544392 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ld5bv\"" Jun 08 15:34:53.552103 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.552076 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:53.553319 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.553303 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p8zzs" Jun 08 15:34:53.683430 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.683405 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p8zzs"] Jun 08 15:34:53.685828 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:34:53.685798 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea0fbd1_bc8c_4c89_a626_b1cbb0858764.slice/crio-3d453887853ee7285ab89aed50c9902123047956e20fe049ddc888511cb630f2 WatchSource:0}: Error finding container 3d453887853ee7285ab89aed50c9902123047956e20fe049ddc888511cb630f2: Status 404 returned error can't find the container with id 3d453887853ee7285ab89aed50c9902123047956e20fe049ddc888511cb630f2 Jun 08 15:34:53.697675 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.697654 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdthd"] Jun 08 15:34:53.699948 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:34:53.699925 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b30f80_2bff_4443_9f2b_edac05778712.slice/crio-e4dc17dd847c0586fb9ab0c2c26112527e1c37785c69345a808b7866eee10d26 WatchSource:0}: Error finding container e4dc17dd847c0586fb9ab0c2c26112527e1c37785c69345a808b7866eee10d26: Status 404 returned error can't find the container with id e4dc17dd847c0586fb9ab0c2c26112527e1c37785c69345a808b7866eee10d26 Jun 08 15:34:53.863828 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.863734 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8zzs" event={"ID":"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764","Type":"ContainerStarted","Data":"3d453887853ee7285ab89aed50c9902123047956e20fe049ddc888511cb630f2"} Jun 08 15:34:53.864796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.864768 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdthd" event={"ID":"f2b30f80-2bff-4443-9f2b-edac05778712","Type":"ContainerStarted","Data":"e4dc17dd847c0586fb9ab0c2c26112527e1c37785c69345a808b7866eee10d26"} Jun 08 15:34:53.864936 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:53.864922 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:34:53.865059 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:53.865047 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:34:53.865110 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:34:53.865101 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:35:25.86508333 +0000 UTC m=+98.805534622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:34:58.881570 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:58.881533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p8zzs" event={"ID":"2ea0fbd1-bc8c-4c89-a626-b1cbb0858764","Type":"ContainerStarted","Data":"a3e199aa7354bf8df8b61d624b89cedce423b38aca227b2defc70b8e07588f27"} Jun 08 15:34:58.883080 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:58.883051 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdthd" event={"ID":"f2b30f80-2bff-4443-9f2b-edac05778712","Type":"ContainerStarted","Data":"0b631f554064492e8c547aa42f3668fb37ff22ce07891ac5f937765b0d527fbe"} Jun 08 15:34:58.883190 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:58.883118 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:34:58.896254 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:58.896199 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p8zzs" podStartSLOduration=67.332612511 podStartE2EDuration="1m11.896181948s" totalImagesPullingTime="4.563569437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:58.895682207 +0000 UTC m=+71.836133525" watchObservedRunningTime="2026-06-08 15:34:58.896181948 +0000 UTC m=+71.836633247" Jun 08 15:34:58.910230 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:34:58.910194 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jdthd" podStartSLOduration=67.371593064 podStartE2EDuration="1m11.910180066s" totalImagesPullingTime="4.538587002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:34:58.909996097 +0000 UTC m=+71.850447393" watchObservedRunningTime="2026-06-08 15:34:58.910180066 +0000 UTC m=+71.850631362" Jun 08 15:35:25.880206 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:35:25.880157 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:35:25.880678 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:35:25.880320 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:35:25.880678 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:35:25.880390 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:36:29.880373043 +0000 UTC m=+162.820824318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:35:29.889127 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:35:29.889095 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jdthd" Jun 08 15:35:57.302130 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:35:57.302076 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:35:57.302654 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:35:57.302203 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 15:35:57.302654 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:35:57.302268 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs podName:fcd28f56-ce33-413d-a37b-0e447a5d1911 nodeName:}" failed. No retries permitted until 2026-06-08 15:37:59.302252625 +0000 UTC m=+252.242703899 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs") pod "network-metrics-daemon-lwcvs" (UID: "fcd28f56-ce33-413d-a37b-0e447a5d1911") : secret "metrics-daemon-secret" not found Jun 08 15:36:24.996416 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:36:24.996370 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-prmb9" podUID="ab8cacf2-eea4-4fe1-8799-8ca1a4761d68" Jun 08 15:36:25.128471 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:25.128446 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prmb9" Jun 08 15:36:26.547881 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:36:26.547836 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lwcvs" podUID="fcd28f56-ce33-413d-a37b-0e447a5d1911" Jun 08 15:36:29.923586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:29.923507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:36:29.924045 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:36:29.923666 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:36:29.924045 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:36:29.923739 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls podName:ab8cacf2-eea4-4fe1-8799-8ca1a4761d68 nodeName:}" failed. No retries permitted until 2026-06-08 15:38:31.923719658 +0000 UTC m=+284.864170933 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls") pod "dns-default-prmb9" (UID: "ab8cacf2-eea4-4fe1-8799-8ca1a4761d68") : secret "dns-default-metrics-tls" not found Jun 08 15:36:30.144379 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:30.144339 2553 generic.go:356] "Generic (PLEG): container finished" podID="2ea30ef0-0abe-45b0-9faa-87228a91cf23" containerID="30209e8128ea169b4aa23aeb1b7d7e5edec5db90621a1de70b371e970da4cb1b" exitCode=255 Jun 08 15:36:30.144544 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:30.144413 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerDied","Data":"30209e8128ea169b4aa23aeb1b7d7e5edec5db90621a1de70b371e970da4cb1b"} Jun 08 15:36:30.144734 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:30.144722 2553 scope.go:117] "RemoveContainer" containerID="30209e8128ea169b4aa23aeb1b7d7e5edec5db90621a1de70b371e970da4cb1b" Jun 08 15:36:31.148839 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:31.148776 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerStarted","Data":"769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d"} Jun 08 15:36:40.519363 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:40.519322 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:36:53.907631 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:53.907590 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fs5kd_1b1c1d85-f60d-4475-b546-3b3ab361404a/dns-node-resolver/0.log" Jun 08 15:36:54.708332 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:54.708306 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vw2z_a6c46255-6957-451e-be9c-5d45a0614ecd/node-ca/0.log" Jun 08 15:36:55.908351 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:36:55.908321 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm5c4_a80a72fe-4a8c-430b-bb45-6afcafdc345d/serve-healthcheck-canary/0.log" Jun 08 15:37:15.624129 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.624096 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zbj2w"] Jun 08 15:37:15.626512 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.626495 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.629471 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.629450 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 15:37:15.631120 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.631083 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 15:37:15.631120 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.631110 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 15:37:15.631264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.631083 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 15:37:15.631264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.631171 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pz2pf\"" Jun 08 15:37:15.638966 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.638945 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zbj2w"] Jun 08 15:37:15.749739 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.749707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2736b56d-8751-4f36-a7b3-bca82fe3e533-data-volume\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.749932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.749769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6ps\" (UniqueName: \"kubernetes.io/projected/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-api-access-sp6ps\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.749932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.749847 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.749932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.749885 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2736b56d-8751-4f36-a7b3-bca82fe3e533-crio-socket\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.749932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.749906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2736b56d-8751-4f36-a7b3-bca82fe3e533-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850385 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2736b56d-8751-4f36-a7b3-bca82fe3e533-crio-socket\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850389 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2736b56d-8751-4f36-a7b3-bca82fe3e533-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2736b56d-8751-4f36-a7b3-bca82fe3e533-data-volume\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850477 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2736b56d-8751-4f36-a7b3-bca82fe3e533-crio-socket\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850483 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6ps\" (UniqueName: \"kubernetes.io/projected/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-api-access-sp6ps\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850787 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850556 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.850889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.850865 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2736b56d-8751-4f36-a7b3-bca82fe3e533-data-volume\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.851087 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.851072 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.852820 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.852781 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2736b56d-8751-4f36-a7b3-bca82fe3e533-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.858858 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.858829 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6ps\" (UniqueName: \"kubernetes.io/projected/2736b56d-8751-4f36-a7b3-bca82fe3e533-kube-api-access-sp6ps\") pod \"insights-runtime-extractor-zbj2w\" (UID: \"2736b56d-8751-4f36-a7b3-bca82fe3e533\") " pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:15.935401 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:15.935319 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zbj2w" Jun 08 15:37:16.053166 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:16.053097 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zbj2w"] Jun 08 15:37:16.055642 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:37:16.055614 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2736b56d_8751_4f36_a7b3_bca82fe3e533.slice/crio-b0d1082f06b72f5ac99a1c3075b894ff5696ea125f67a76679102e6317abedaf WatchSource:0}: Error finding container b0d1082f06b72f5ac99a1c3075b894ff5696ea125f67a76679102e6317abedaf: Status 404 returned error can't find the container with id b0d1082f06b72f5ac99a1c3075b894ff5696ea125f67a76679102e6317abedaf Jun 08 15:37:16.273291 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:16.273255 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbj2w" event={"ID":"2736b56d-8751-4f36-a7b3-bca82fe3e533","Type":"ContainerStarted","Data":"f4ffb36784f03a49e2c1f956d918d20fe158239a4d5b5266867f62ec58a7658b"} Jun 08 15:37:16.273504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:16.273311 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbj2w" event={"ID":"2736b56d-8751-4f36-a7b3-bca82fe3e533","Type":"ContainerStarted","Data":"b0d1082f06b72f5ac99a1c3075b894ff5696ea125f67a76679102e6317abedaf"} Jun 08 15:37:17.279001 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:17.278963 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbj2w" event={"ID":"2736b56d-8751-4f36-a7b3-bca82fe3e533","Type":"ContainerStarted","Data":"977fcbf82c5bd9b25e8e5d4ed873c014955a3925b57f2eebd2d196f69e054f14"} Jun 08 15:37:19.287178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:19.287138 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbj2w" event={"ID":"2736b56d-8751-4f36-a7b3-bca82fe3e533","Type":"ContainerStarted","Data":"565caa8b54d00631fc332e9701dbc551c14e0d990685d751e65b00cdac757eff"} Jun 08 15:37:30.779662 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.779591 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zbj2w" podStartSLOduration=13.69604784 podStartE2EDuration="15.779574217s" totalImagesPullingTime="2.083526377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:37:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:37:19.307172791 +0000 UTC m=+212.247624087" watchObservedRunningTime="2026-06-08 15:37:30.779574217 +0000 UTC m=+223.720025512" Jun 08 15:37:30.780085 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.779907 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qfb5t"] Jun 08 15:37:30.782191 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.782172 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.785047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.785022 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9h8s5\"" Jun 08 15:37:30.786485 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786469 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 15:37:30.786581 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786487 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 15:37:30.786581 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786471 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 15:37:30.786581 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786511 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 15:37:30.786727 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786669 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 15:37:30.786842 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.786828 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 15:37:30.861915 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.861879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-sys\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.861915 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.861919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862115 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.861948 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-metrics-client-ca\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862115 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-root\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862115 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862077 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tcv2\" (UniqueName: \"kubernetes.io/projected/ba7851d1-3446-4601-a10f-81d54c0419d6-kube-api-access-4tcv2\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862115 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862105 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-tls\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862237 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-wtmp\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862237 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862140 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.862237 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.862157 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-textfile\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.962863 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tcv2\" (UniqueName: \"kubernetes.io/projected/ba7851d1-3446-4601-a10f-81d54c0419d6-kube-api-access-4tcv2\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-tls\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962888 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-wtmp\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-textfile\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962976 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-sys\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963022 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.962998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963313 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-metrics-client-ca\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963313 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-root\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963313 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963069 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-wtmp\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963313 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963143 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-root\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963313 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963143 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba7851d1-3446-4601-a10f-81d54c0419d6-sys\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963545 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963492 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-textfile\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963613 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963560 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.963711 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.963693 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba7851d1-3446-4601-a10f-81d54c0419d6-metrics-client-ca\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.965457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.965433 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.965565 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.965470 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba7851d1-3446-4601-a10f-81d54c0419d6-node-exporter-tls\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:30.971192 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:30.971170 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tcv2\" (UniqueName: \"kubernetes.io/projected/ba7851d1-3446-4601-a10f-81d54c0419d6-kube-api-access-4tcv2\") pod \"node-exporter-qfb5t\" (UID: \"ba7851d1-3446-4601-a10f-81d54c0419d6\") " pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:31.091405 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.091315 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qfb5t" Jun 08 15:37:31.100334 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:37:31.100308 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7851d1_3446_4601_a10f_81d54c0419d6.slice/crio-9b79ed19e9cb53a58795168b4bf32f37167962252aca72be735d1f1be1358fb2 WatchSource:0}: Error finding container 9b79ed19e9cb53a58795168b4bf32f37167962252aca72be735d1f1be1358fb2: Status 404 returned error can't find the container with id 9b79ed19e9cb53a58795168b4bf32f37167962252aca72be735d1f1be1358fb2 Jun 08 15:37:31.323312 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.323275 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfb5t" event={"ID":"ba7851d1-3446-4601-a10f-81d54c0419d6","Type":"ContainerStarted","Data":"9b79ed19e9cb53a58795168b4bf32f37167962252aca72be735d1f1be1358fb2"} Jun 08 15:37:31.803849 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.803808 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:37:31.807279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.807256 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.810226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810207 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 15:37:31.810396 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810363 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 15:37:31.810396 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810387 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 15:37:31.810735 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810710 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 15:37:31.810735 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810725 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 15:37:31.810912 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810762 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 15:37:31.810912 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810784 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s62l4\"" Jun 08 15:37:31.811073 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.810913 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 15:37:31.811073 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.811037 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 15:37:31.811073 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.811043 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 15:37:31.821264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.821245 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:37:31.972646 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972617 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972646 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972652 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzt4m\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972734 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972752 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972774 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972798 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972814 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.972870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972870 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.973111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972888 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.973111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972908 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.973111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.972925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:31.973111 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:31.973037 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.073924 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.073857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.073924 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.073887 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.073924 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.073907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.073931 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.073957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074069 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074101 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074165 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074569 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074175 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074569 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074203 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074569 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzt4m\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.074569 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.074470 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.076257 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.075930 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.078456 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.077536 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.078456 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.077905 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.078456 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.077930 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.078456 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.078262 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.078717 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.078537 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.079449 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.079421 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.079612 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.079572 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.080095 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.080061 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.080537 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.080517 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.082977 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.081939 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.084417 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.084395 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzt4m\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m\") pod \"alertmanager-main-0\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.117720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.117694 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:37:32.246370 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.246345 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:37:32.248218 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:37:32.248192 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576cfeec_a543_4ee3_9187_d4101c6034a1.slice/crio-f61aa4372a5937ed909e2817bd365ed7eaa6380814cdbeae2204fdc7734511c3 WatchSource:0}: Error finding container f61aa4372a5937ed909e2817bd365ed7eaa6380814cdbeae2204fdc7734511c3: Status 404 returned error can't find the container with id f61aa4372a5937ed909e2817bd365ed7eaa6380814cdbeae2204fdc7734511c3 Jun 08 15:37:32.328212 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.328120 2553 generic.go:356] "Generic (PLEG): container finished" podID="ba7851d1-3446-4601-a10f-81d54c0419d6" containerID="83a6f85bd5b0c85d64b807bfcc61b5b5cae680909cfad9089cf4de56cf54c504" exitCode=0 Jun 08 15:37:32.328374 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.328213 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfb5t" event={"ID":"ba7851d1-3446-4601-a10f-81d54c0419d6","Type":"ContainerDied","Data":"83a6f85bd5b0c85d64b807bfcc61b5b5cae680909cfad9089cf4de56cf54c504"} Jun 08 15:37:32.329527 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:32.329436 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"f61aa4372a5937ed909e2817bd365ed7eaa6380814cdbeae2204fdc7734511c3"} Jun 08 15:37:33.337926 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:33.337902 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfb5t" event={"ID":"ba7851d1-3446-4601-a10f-81d54c0419d6","Type":"ContainerStarted","Data":"c7bef5c705458d4984f3cea0178c237f5ccf4fe09012a508e53b1d9e532bf32a"} Jun 08 15:37:33.338213 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:33.337951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qfb5t" event={"ID":"ba7851d1-3446-4601-a10f-81d54c0419d6","Type":"ContainerStarted","Data":"2eecaf9c2faf12206b742278272cc61864566a5fb9d3ac56d31b199a38c871e3"} Jun 08 15:37:33.361481 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:33.361440 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qfb5t" podStartSLOduration=2.525644123 podStartE2EDuration="3.36142536s" totalImagesPullingTime="771.243262ms" totalInitContainerRuntime="64.537975ms" isStatefulPod=true podCreationTimestamp="2026-06-08 15:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:37:33.359719136 +0000 UTC m=+226.300170432" watchObservedRunningTime="2026-06-08 15:37:33.36142536 +0000 UTC m=+226.301876656" Jun 08 15:37:34.342901 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:34.342869 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="bee1cc3644dd7f1291d91cf96a594a6d8413cd41db47226e9f42f611a82c5292" exitCode=0 Jun 08 15:37:34.343304 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:34.342954 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"bee1cc3644dd7f1291d91cf96a594a6d8413cd41db47226e9f42f611a82c5292"} Jun 08 15:37:36.353229 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:36.353194 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"275f9f032d710395f0f356334187caf6b6d5623eaa096088f4b20e6b12f43a31"} Jun 08 15:37:36.353584 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:36.353301 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"f14731800e7c2e0ac050d7f19ed3ac55e7beeb73e0df15b6b6894f1d7a2c5d23"} Jun 08 15:37:36.353584 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:36.353337 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"0941e557f6e0cc4f302da4eae1c3abebfdb990e99b73faf96754741c17f6ddc1"} Jun 08 15:37:36.353584 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:36.353363 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"5e4691a7574c1f3e9fdb095ece3ea93b7f91ef647f9551dd013f47b1c0b92c10"} Jun 08 15:37:36.353584 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:36.353388 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"27a0a0e15a8c44096f828c4a4778b4e59bb2ffe49f47740596afaccc68057af1"} Jun 08 15:37:37.361081 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:37.361043 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerStarted","Data":"956e429c9691e9efe36525409d955c448648837735aefc85a9276a29fccc3199"} Jun 08 15:37:37.386968 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:37.386917 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.045966647 podStartE2EDuration="6.386902917s" totalImagesPullingTime="3.324444249s" totalInitContainerRuntime="16.492021ms" isStatefulPod=false podCreationTimestamp="2026-06-08 15:37:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:37:37.385086674 +0000 UTC m=+230.325537993" watchObservedRunningTime="2026-06-08 15:37:37.386902917 +0000 UTC m=+230.327354214" Jun 08 15:37:43.990816 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:43.990783 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-dtfkl"] Jun 08 15:37:43.993991 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:43.993975 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:37:43.997131 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:43.997111 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g4k7x\"" Jun 08 15:37:43.997245 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:43.997157 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 15:37:43.997245 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:43.997206 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 15:37:44.004223 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.004195 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dtfkl"] Jun 08 15:37:44.072358 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.072324 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpffj\" (UniqueName: \"kubernetes.io/projected/b54a3050-8610-428d-9a65-0ed06ac78f14-kube-api-access-mpffj\") pod \"downloads-6657875f97-dtfkl\" (UID: \"b54a3050-8610-428d-9a65-0ed06ac78f14\") " pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:37:44.173634 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.173577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpffj\" (UniqueName: \"kubernetes.io/projected/b54a3050-8610-428d-9a65-0ed06ac78f14-kube-api-access-mpffj\") pod \"downloads-6657875f97-dtfkl\" (UID: \"b54a3050-8610-428d-9a65-0ed06ac78f14\") " pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:37:44.188701 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.188677 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpffj\" (UniqueName: \"kubernetes.io/projected/b54a3050-8610-428d-9a65-0ed06ac78f14-kube-api-access-mpffj\") pod \"downloads-6657875f97-dtfkl\" (UID: \"b54a3050-8610-428d-9a65-0ed06ac78f14\") " pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:37:44.303398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.303349 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:37:44.424775 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:44.424739 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dtfkl"] Jun 08 15:37:44.428516 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:37:44.428491 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54a3050_8610_428d_9a65_0ed06ac78f14.slice/crio-ea1e472909e5b6eabe6a8471e067ab3fc25fd4de6be4b5cca0bd5ae56bc3d4bc WatchSource:0}: Error finding container ea1e472909e5b6eabe6a8471e067ab3fc25fd4de6be4b5cca0bd5ae56bc3d4bc: Status 404 returned error can't find the container with id ea1e472909e5b6eabe6a8471e067ab3fc25fd4de6be4b5cca0bd5ae56bc3d4bc Jun 08 15:37:45.388431 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:45.388391 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dtfkl" event={"ID":"b54a3050-8610-428d-9a65-0ed06ac78f14","Type":"ContainerStarted","Data":"ea1e472909e5b6eabe6a8471e067ab3fc25fd4de6be4b5cca0bd5ae56bc3d4bc"} Jun 08 15:37:49.099539 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.099506 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:37:49.103646 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.103624 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.106673 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.106649 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 15:37:49.108105 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.108085 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 15:37:49.108264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.108100 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8p72b\"" Jun 08 15:37:49.108264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.108165 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 15:37:49.108264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.108108 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 15:37:49.108264 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.108107 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 15:37:49.109711 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109686 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.109834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbcvb\" (UniqueName: \"kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.109834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109825 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.109950 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109854 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.109950 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109891 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.110050 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.109941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.113539 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.113520 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:37:49.211203 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211164 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.211356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211215 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.211356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211245 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.211356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211271 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.211356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211344 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.211553 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.211368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbcvb\" (UniqueName: \"kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.212267 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.212236 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.212384 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.212276 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.212384 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.212276 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.213839 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.213816 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.213942 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.213899 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.219322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.219299 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbcvb\" (UniqueName: \"kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb\") pod \"console-7b6c6bd8c5-v9kc5\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.415239 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.415144 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:49.558492 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:49.558463 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:37:49.561124 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:37:49.561095 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf093e76_8aa6_4d1a_a386_3e1bafe38761.slice/crio-ec49c804b6eb0ebaeb76f5ee908c1ae87d055ca097c8d1e38368760410ef756a WatchSource:0}: Error finding container ec49c804b6eb0ebaeb76f5ee908c1ae87d055ca097c8d1e38368760410ef756a: Status 404 returned error can't find the container with id ec49c804b6eb0ebaeb76f5ee908c1ae87d055ca097c8d1e38368760410ef756a Jun 08 15:37:50.410027 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:50.409988 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6c6bd8c5-v9kc5" event={"ID":"af093e76-8aa6-4d1a-a386-3e1bafe38761","Type":"ContainerStarted","Data":"ec49c804b6eb0ebaeb76f5ee908c1ae87d055ca097c8d1e38368760410ef756a"} Jun 08 15:37:53.423226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:53.423186 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6c6bd8c5-v9kc5" event={"ID":"af093e76-8aa6-4d1a-a386-3e1bafe38761","Type":"ContainerStarted","Data":"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e"} Jun 08 15:37:53.441150 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:53.441087 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podStartSLOduration=1.086668743 podStartE2EDuration="4.441068328s" totalImagesPullingTime="3.354399585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:37:53.44033023 +0000 UTC m=+246.380781527" watchObservedRunningTime="2026-06-08 15:37:53.441068328 +0000 UTC m=+246.381519629" Jun 08 15:37:59.399338 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.399297 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:37:59.401965 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.401935 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcd28f56-ce33-413d-a37b-0e447a5d1911-metrics-certs\") pod \"network-metrics-daemon-lwcvs\" (UID: \"fcd28f56-ce33-413d-a37b-0e447a5d1911\") " pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:37:59.415794 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.415767 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:59.415920 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.415826 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:37:59.417322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.417296 2553 patch_prober.go:28] interesting pod/console-7b6c6bd8c5-v9kc5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 08 15:37:59.417434 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.417354 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 08 15:37:59.423303 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.423278 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-54ltp\"" Jun 08 15:37:59.430796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:37:59.430767 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lwcvs" Jun 08 15:38:00.859585 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:00.859539 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lwcvs"] Jun 08 15:38:00.866798 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:38:00.866769 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd28f56_ce33_413d_a37b_0e447a5d1911.slice/crio-c7a9ca05a490b4046392efa86ffd38773ffb2217868fdf3003c5630d10f6c27b WatchSource:0}: Error finding container c7a9ca05a490b4046392efa86ffd38773ffb2217868fdf3003c5630d10f6c27b: Status 404 returned error can't find the container with id c7a9ca05a490b4046392efa86ffd38773ffb2217868fdf3003c5630d10f6c27b Jun 08 15:38:01.455519 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:01.455486 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dtfkl" event={"ID":"b54a3050-8610-428d-9a65-0ed06ac78f14","Type":"ContainerStarted","Data":"63c62c0a27fdbb57ebc294a8cbf4421512a81bfcc107e332b9bff0a0df7cdcc0"} Jun 08 15:38:01.455715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:01.455669 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:38:01.457441 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:01.457325 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwcvs" event={"ID":"fcd28f56-ce33-413d-a37b-0e447a5d1911","Type":"ContainerStarted","Data":"c7a9ca05a490b4046392efa86ffd38773ffb2217868fdf3003c5630d10f6c27b"} Jun 08 15:38:01.469348 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:01.469320 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-dtfkl" Jun 08 15:38:01.479158 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:01.479089 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-dtfkl" podStartSLOduration=2.074347306 podStartE2EDuration="18.479068115s" totalImagesPullingTime="16.404720809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:38:01.478408344 +0000 UTC m=+254.418859641" watchObservedRunningTime="2026-06-08 15:38:01.479068115 +0000 UTC m=+254.419519431" Jun 08 15:38:02.464873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:02.464767 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwcvs" event={"ID":"fcd28f56-ce33-413d-a37b-0e447a5d1911","Type":"ContainerStarted","Data":"afaaef96c9aca4f26f5c647e3dabd750f1cbc9e59bd8cd3d91f5af3d01d9778e"} Jun 08 15:38:02.464873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:02.464836 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lwcvs" event={"ID":"fcd28f56-ce33-413d-a37b-0e447a5d1911","Type":"ContainerStarted","Data":"e9eb9a06d2520dc40a4a075ac62b12e9db0d76b2c16041b3fdb16d2030dc2501"} Jun 08 15:38:02.481491 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:02.481436 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lwcvs" podStartSLOduration=254.343017521 podStartE2EDuration="4m15.481414688s" totalImagesPullingTime="1.138397167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:38:02.479552331 +0000 UTC m=+255.420003693" watchObservedRunningTime="2026-06-08 15:38:02.481414688 +0000 UTC m=+255.421865985" Jun 08 15:38:04.842705 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:04.842679 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fs5kd_1b1c1d85-f60d-4475-b546-3b3ab361404a/dns-node-resolver/0.log" Jun 08 15:38:05.642775 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:05.642743 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vw2z_a6c46255-6957-451e-be9c-5d45a0614ecd/node-ca/0.log" Jun 08 15:38:06.843800 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:06.843770 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm5c4_a80a72fe-4a8c-430b-bb45-6afcafdc345d/serve-healthcheck-canary/0.log" Jun 08 15:38:09.415891 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:09.415853 2553 patch_prober.go:28] interesting pod/console-7b6c6bd8c5-v9kc5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 08 15:38:09.416333 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:09.415910 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 08 15:38:19.415887 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:19.415851 2553 patch_prober.go:28] interesting pod/console-7b6c6bd8c5-v9kc5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 08 15:38:19.416362 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:19.415909 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 08 15:38:23.745660 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:23.745620 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" podUID="188d057c-f7d5-494a-96e2-0a82b428d10c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:38:28.129103 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:38:28.129063 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-prmb9" podUID="ab8cacf2-eea4-4fe1-8799-8ca1a4761d68" Jun 08 15:38:28.557543 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:28.557518 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:29.416300 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:29.416262 2553 patch_prober.go:28] interesting pod/console-7b6c6bd8c5-v9kc5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 08 15:38:29.416705 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:29.416317 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 08 15:38:30.566062 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:30.566030 2553 generic.go:356] "Generic (PLEG): container finished" podID="2ea30ef0-0abe-45b0-9faa-87228a91cf23" containerID="769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d" exitCode=255 Jun 08 15:38:30.566507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:30.566106 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerDied","Data":"769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d"} Jun 08 15:38:30.566507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:30.566163 2553 scope.go:117] "RemoveContainer" containerID="30209e8128ea169b4aa23aeb1b7d7e5edec5db90621a1de70b371e970da4cb1b" Jun 08 15:38:30.566507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:30.566433 2553 scope.go:117] "RemoveContainer" containerID="769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d" Jun 08 15:38:30.566696 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:38:30.566636 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8545868bb8-jgm47_open-cluster-management-agent-addon(2ea30ef0-0abe-45b0-9faa-87228a91cf23)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" podUID="2ea30ef0-0abe-45b0-9faa-87228a91cf23" Jun 08 15:38:31.973642 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:31.973584 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:31.975880 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:31.975860 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab8cacf2-eea4-4fe1-8799-8ca1a4761d68-metrics-tls\") pod \"dns-default-prmb9\" (UID: \"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68\") " pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:32.161770 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:32.161741 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p7nwf\"" Jun 08 15:38:32.169356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:32.169330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:32.320061 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:32.320036 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-prmb9"] Jun 08 15:38:32.322296 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:38:32.322268 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8cacf2_eea4_4fe1_8799_8ca1a4761d68.slice/crio-14c56f1b2396a7c13a13ed04e047a80aeb827fc745d03abe0f8fe26b243d6734 WatchSource:0}: Error finding container 14c56f1b2396a7c13a13ed04e047a80aeb827fc745d03abe0f8fe26b243d6734: Status 404 returned error can't find the container with id 14c56f1b2396a7c13a13ed04e047a80aeb827fc745d03abe0f8fe26b243d6734 Jun 08 15:38:32.575958 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:32.575924 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prmb9" event={"ID":"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68","Type":"ContainerStarted","Data":"14c56f1b2396a7c13a13ed04e047a80aeb827fc745d03abe0f8fe26b243d6734"} Jun 08 15:38:33.736057 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:33.736025 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" Jun 08 15:38:33.736501 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:33.736384 2553 scope.go:117] "RemoveContainer" containerID="769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d" Jun 08 15:38:33.736610 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:38:33.736578 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-8545868bb8-jgm47_open-cluster-management-agent-addon(2ea30ef0-0abe-45b0-9faa-87228a91cf23)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" podUID="2ea30ef0-0abe-45b0-9faa-87228a91cf23" Jun 08 15:38:33.744806 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:33.744775 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" podUID="188d057c-f7d5-494a-96e2-0a82b428d10c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:38:35.587694 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:35.587657 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prmb9" event={"ID":"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68","Type":"ContainerStarted","Data":"a24087413cd44a21a5dd8b34df6a8025531d19be0eb3325d0dde6c5eae0aae0a"} Jun 08 15:38:35.588119 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:35.587704 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-prmb9" event={"ID":"ab8cacf2-eea4-4fe1-8799-8ca1a4761d68","Type":"ContainerStarted","Data":"0627f3fa1d29b11e8f286414223dfaed259d5e3d16dd1bb87e08a8d6367c9708"} Jun 08 15:38:35.588119 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:35.587767 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:35.605064 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:35.605020 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-prmb9" podStartSLOduration=252.207575809 podStartE2EDuration="4m14.605003881s" totalImagesPullingTime="2.397428072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:38:35.603801215 +0000 UTC m=+288.544252515" watchObservedRunningTime="2026-06-08 15:38:35.605003881 +0000 UTC m=+288.545455178" Jun 08 15:38:39.110765 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:39.110729 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:38:43.745223 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:43.745183 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" podUID="188d057c-f7d5-494a-96e2-0a82b428d10c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:38:43.745583 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:43.745256 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" Jun 08 15:38:43.745846 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:43.745806 2553 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4964d2d34756ee2ba52ca51aaa20816335698053a2c0a677d82267d3602061ce"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 15:38:43.745883 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:43.745867 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" podUID="188d057c-f7d5-494a-96e2-0a82b428d10c" containerName="service-proxy" containerID="cri-o://4964d2d34756ee2ba52ca51aaa20816335698053a2c0a677d82267d3602061ce" gracePeriod=30 Jun 08 15:38:44.619334 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:44.619301 2553 generic.go:356] "Generic (PLEG): container finished" podID="188d057c-f7d5-494a-96e2-0a82b428d10c" containerID="4964d2d34756ee2ba52ca51aaa20816335698053a2c0a677d82267d3602061ce" exitCode=2 Jun 08 15:38:44.619509 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:44.619367 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerDied","Data":"4964d2d34756ee2ba52ca51aaa20816335698053a2c0a677d82267d3602061ce"} Jun 08 15:38:44.619509 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:44.619413 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5bc48f9d-62t2g" event={"ID":"188d057c-f7d5-494a-96e2-0a82b428d10c","Type":"ContainerStarted","Data":"7fea13f76aa13f4d1f9eca933e172ebe990f48d5104abfb61403edd8de9bc831"} Jun 08 15:38:45.593047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:45.593018 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-prmb9" Jun 08 15:38:46.519915 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:46.519882 2553 scope.go:117] "RemoveContainer" containerID="769d212b4b7028a46fab179a52d8ac69a5793ef1fd55ae15466ae503b0214f8d" Jun 08 15:38:46.627736 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:46.627701 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8545868bb8-jgm47" event={"ID":"2ea30ef0-0abe-45b0-9faa-87228a91cf23","Type":"ContainerStarted","Data":"aeff1c3a6e24856322fe743ce6e35398fc7fbd0a9a68bc7a3928e3896daf4380"} Jun 08 15:38:47.466176 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:47.466147 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:38:47.469899 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:47.469878 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:38:47.472769 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:47.472745 2553 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 15:38:50.941318 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.941286 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.941979 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="alertmanager" containerID="cri-o://27a0a0e15a8c44096f828c4a4778b4e59bb2ffe49f47740596afaccc68057af1" gracePeriod=120 Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.942274 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy" containerID="cri-o://f14731800e7c2e0ac050d7f19ed3ac55e7beeb73e0df15b6b6894f1d7a2c5d23" gracePeriod=120 Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.942436 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-web" containerID="cri-o://0941e557f6e0cc4f302da4eae1c3abebfdb990e99b73faf96754741c17f6ddc1" gracePeriod=120 Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.942462 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-metric" containerID="cri-o://275f9f032d710395f0f356334187caf6b6d5623eaa096088f4b20e6b12f43a31" gracePeriod=120 Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.942441 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="prom-label-proxy" containerID="cri-o://956e429c9691e9efe36525409d955c448648837735aefc85a9276a29fccc3199" gracePeriod=120 Jun 08 15:38:50.946483 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:50.942560 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="config-reloader" containerID="cri-o://5e4691a7574c1f3e9fdb095ece3ea93b7f91ef647f9551dd013f47b1c0b92c10" gracePeriod=120 Jun 08 15:38:51.647032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647001 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="956e429c9691e9efe36525409d955c448648837735aefc85a9276a29fccc3199" exitCode=0 Jun 08 15:38:51.647032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647025 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="f14731800e7c2e0ac050d7f19ed3ac55e7beeb73e0df15b6b6894f1d7a2c5d23" exitCode=0 Jun 08 15:38:51.647032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647031 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="5e4691a7574c1f3e9fdb095ece3ea93b7f91ef647f9551dd013f47b1c0b92c10" exitCode=0 Jun 08 15:38:51.647032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647037 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="27a0a0e15a8c44096f828c4a4778b4e59bb2ffe49f47740596afaccc68057af1" exitCode=0 Jun 08 15:38:51.647301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647075 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"956e429c9691e9efe36525409d955c448648837735aefc85a9276a29fccc3199"} Jun 08 15:38:51.647301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647149 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"f14731800e7c2e0ac050d7f19ed3ac55e7beeb73e0df15b6b6894f1d7a2c5d23"} Jun 08 15:38:51.647301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647178 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"5e4691a7574c1f3e9fdb095ece3ea93b7f91ef647f9551dd013f47b1c0b92c10"} Jun 08 15:38:51.647301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:51.647204 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"27a0a0e15a8c44096f828c4a4778b4e59bb2ffe49f47740596afaccc68057af1"} Jun 08 15:38:52.656116 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.656073 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="275f9f032d710395f0f356334187caf6b6d5623eaa096088f4b20e6b12f43a31" exitCode=0 Jun 08 15:38:52.656116 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.656102 2553 generic.go:356] "Generic (PLEG): container finished" podID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerID="0941e557f6e0cc4f302da4eae1c3abebfdb990e99b73faf96754741c17f6ddc1" exitCode=0 Jun 08 15:38:52.656634 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.656131 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"275f9f032d710395f0f356334187caf6b6d5623eaa096088f4b20e6b12f43a31"} Jun 08 15:38:52.656634 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.656193 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"0941e557f6e0cc4f302da4eae1c3abebfdb990e99b73faf96754741c17f6ddc1"} Jun 08 15:38:52.680832 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.680807 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:52.730813 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730772 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.730813 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730806 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730833 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730863 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730897 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730938 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.730991 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731015 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731047 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731042 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzt4m\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731412 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731080 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731412 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731112 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731412 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731148 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.731412 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731175 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca\") pod \"576cfeec-a543-4ee3-9187-d4101c6034a1\" (UID: \"576cfeec-a543-4ee3-9187-d4101c6034a1\") " Jun 08 15:38:52.732338 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731324 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:38:52.732504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.731740 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:38:52.732672 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.732644 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736496 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736540 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736560 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736586 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736624 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume" (OuterVolumeSpecName: "config-volume") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.736677 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736641 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out" (OuterVolumeSpecName: "config-out") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:38:52.737038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736780 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m" (OuterVolumeSpecName: "kube-api-access-dzt4m") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "kube-api-access-dzt4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:38:52.737038 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.736950 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.739341 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.739314 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.744655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.744627 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config" (OuterVolumeSpecName: "web-config") pod "576cfeec-a543-4ee3-9187-d4101c6034a1" (UID: "576cfeec-a543-4ee3-9187-d4101c6034a1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833075 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-main-db\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833119 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833131 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833140 2553 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-metrics-client-ca\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833150 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576cfeec-a543-4ee3-9187-d4101c6034a1-config-out\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833159 2553 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-config-volume\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833168 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-web-config\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833175 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576cfeec-a543-4ee3-9187-d4101c6034a1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833184 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833177 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833193 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-secret-alertmanager-main-tls\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833627 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833201 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-tls-assets\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833627 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833209 2553 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/576cfeec-a543-4ee3-9187-d4101c6034a1-cluster-tls-config\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:52.833627 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:52.833217 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzt4m\" (UniqueName: \"kubernetes.io/projected/576cfeec-a543-4ee3-9187-d4101c6034a1-kube-api-access-dzt4m\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:38:53.662511 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.662475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"576cfeec-a543-4ee3-9187-d4101c6034a1","Type":"ContainerDied","Data":"f61aa4372a5937ed909e2817bd365ed7eaa6380814cdbeae2204fdc7734511c3"} Jun 08 15:38:53.662511 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.662504 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.663052 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.662549 2553 scope.go:117] "RemoveContainer" containerID="956e429c9691e9efe36525409d955c448648837735aefc85a9276a29fccc3199" Jun 08 15:38:53.670495 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.670476 2553 scope.go:117] "RemoveContainer" containerID="275f9f032d710395f0f356334187caf6b6d5623eaa096088f4b20e6b12f43a31" Jun 08 15:38:53.677088 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.677072 2553 scope.go:117] "RemoveContainer" containerID="f14731800e7c2e0ac050d7f19ed3ac55e7beeb73e0df15b6b6894f1d7a2c5d23" Jun 08 15:38:53.683224 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.683208 2553 scope.go:117] "RemoveContainer" containerID="0941e557f6e0cc4f302da4eae1c3abebfdb990e99b73faf96754741c17f6ddc1" Jun 08 15:38:53.687223 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.687203 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:53.689887 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.689869 2553 scope.go:117] "RemoveContainer" containerID="5e4691a7574c1f3e9fdb095ece3ea93b7f91ef647f9551dd013f47b1c0b92c10" Jun 08 15:38:53.692900 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.692879 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:53.696692 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.696670 2553 scope.go:117] "RemoveContainer" containerID="27a0a0e15a8c44096f828c4a4778b4e59bb2ffe49f47740596afaccc68057af1" Jun 08 15:38:53.704449 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.704427 2553 scope.go:117] "RemoveContainer" containerID="bee1cc3644dd7f1291d91cf96a594a6d8413cd41db47226e9f42f611a82c5292" Jun 08 15:38:53.724445 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724422 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:53.724661 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724649 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-web" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724663 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-web" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724671 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="alertmanager" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724677 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="alertmanager" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724686 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="config-reloader" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724692 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="config-reloader" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724701 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="prom-label-proxy" Jun 08 15:38:53.724708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724706 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="prom-label-proxy" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724714 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724719 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724724 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="init-config-reloader" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724730 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="init-config-reloader" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724735 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-metric" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724740 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-metric" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724780 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724787 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="prom-label-proxy" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724794 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-web" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724799 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="config-reloader" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724805 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="alertmanager" Jun 08 15:38:53.724911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.724810 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" containerName="kube-rbac-proxy-metric" Jun 08 15:38:53.727958 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.727940 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.730922 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.730902 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 15:38:53.730922 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.730912 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 15:38:53.731144 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731125 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 15:38:53.731212 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731172 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 15:38:53.731275 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731260 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 15:38:53.731411 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731393 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 15:38:53.731473 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731433 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s62l4\"" Jun 08 15:38:53.731473 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.731431 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 15:38:53.732487 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.732472 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 15:38:53.737864 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.737848 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 15:38:53.745531 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.745506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:53.843375 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843290 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-config-out\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843375 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843326 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843375 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843348 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdth9\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-kube-api-access-gdth9\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843375 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843408 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843449 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843529 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843567 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843586 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-web-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.843655 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.843634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944379 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-config-out\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944379 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944419 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdth9\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-kube-api-access-gdth9\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944448 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944472 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944492 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944523 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944747 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944770 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-web-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944797 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.944940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.944888 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.945289 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.945159 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.945409 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.945384 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4abe462-1e03-4d20-858c-c4670f7357ba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.947400 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.947370 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f4abe462-1e03-4d20-858c-c4670f7357ba-config-out\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.947690 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.947653 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.947690 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.947680 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.947842 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.947752 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.947978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.947963 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.948076 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.948057 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.948244 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.948224 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-web-config\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.948338 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.948323 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-config-volume\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.949356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.949334 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4abe462-1e03-4d20-858c-c4670f7357ba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:53.952672 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:53.952652 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdth9\" (UniqueName: \"kubernetes.io/projected/f4abe462-1e03-4d20-858c-c4670f7357ba-kube-api-access-gdth9\") pod \"alertmanager-main-0\" (UID: \"f4abe462-1e03-4d20-858c-c4670f7357ba\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:54.036892 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.036861 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 15:38:54.167685 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.167660 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 15:38:54.169777 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:38:54.169748 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4abe462_1e03_4d20_858c_c4670f7357ba.slice/crio-613ee16dda3b6b7d60f6a589bab4ebd878d7abbdf3ab826cf774ddc0c7e07af5 WatchSource:0}: Error finding container 613ee16dda3b6b7d60f6a589bab4ebd878d7abbdf3ab826cf774ddc0c7e07af5: Status 404 returned error can't find the container with id 613ee16dda3b6b7d60f6a589bab4ebd878d7abbdf3ab826cf774ddc0c7e07af5 Jun 08 15:38:54.666986 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.666949 2553 generic.go:356] "Generic (PLEG): container finished" podID="f4abe462-1e03-4d20-858c-c4670f7357ba" containerID="917a54cf453759ecfbd9e56fb026379e1200984473ca52dae9b647320522fd8a" exitCode=0 Jun 08 15:38:54.667453 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.667034 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerDied","Data":"917a54cf453759ecfbd9e56fb026379e1200984473ca52dae9b647320522fd8a"} Jun 08 15:38:54.667453 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.667096 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"613ee16dda3b6b7d60f6a589bab4ebd878d7abbdf3ab826cf774ddc0c7e07af5"} Jun 08 15:38:54.961417 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.961387 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-644b997c57-c6mtb"] Jun 08 15:38:54.964048 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.964023 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:54.966670 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.966626 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 15:38:54.967178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.966913 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 15:38:54.967178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.966989 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 15:38:54.967178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.966916 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 15:38:54.967178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.967060 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 15:38:54.967421 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.967276 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8c588\"" Jun 08 15:38:54.972243 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.972218 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 15:38:54.980000 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:54.979957 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-644b997c57-c6mtb"] Jun 08 15:38:55.054913 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.054886 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-metrics-client-ca\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055085 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.054919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-serving-certs-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055085 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.054941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055085 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.055000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-federate-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055085 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.055058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055282 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.055110 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055282 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.055148 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfrw6\" (UniqueName: \"kubernetes.io/projected/4560d8f3-c6ce-477a-aaff-4c544734ccab-kube-api-access-jfrw6\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.055282 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.055178 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156225 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156186 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156225 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156228 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfrw6\" (UniqueName: \"kubernetes.io/projected/4560d8f3-c6ce-477a-aaff-4c544734ccab-kube-api-access-jfrw6\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156248 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156478 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156291 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-metrics-client-ca\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156580 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-serving-certs-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156580 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156515 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156580 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156555 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-federate-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.156766 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.156636 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.157122 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.157099 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-metrics-client-ca\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.157241 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.157207 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-serving-certs-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.157376 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.157355 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.158957 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.158930 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.158957 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.158950 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-secret-telemeter-client\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.159202 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.159183 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-telemeter-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.159360 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.159342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4560d8f3-c6ce-477a-aaff-4c544734ccab-federate-client-tls\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.164077 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.164056 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfrw6\" (UniqueName: \"kubernetes.io/projected/4560d8f3-c6ce-477a-aaff-4c544734ccab-kube-api-access-jfrw6\") pod \"telemeter-client-644b997c57-c6mtb\" (UID: \"4560d8f3-c6ce-477a-aaff-4c544734ccab\") " pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.289432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.289406 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" Jun 08 15:38:55.419968 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.419942 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-644b997c57-c6mtb"] Jun 08 15:38:55.422059 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:38:55.422027 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4560d8f3_c6ce_477a_aaff_4c544734ccab.slice/crio-60e32c9f3bf77af512c3f366cc3651277990b081549ac0c9da0cb78f9f784f97 WatchSource:0}: Error finding container 60e32c9f3bf77af512c3f366cc3651277990b081549ac0c9da0cb78f9f784f97: Status 404 returned error can't find the container with id 60e32c9f3bf77af512c3f366cc3651277990b081549ac0c9da0cb78f9f784f97 Jun 08 15:38:55.424099 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.424081 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 15:38:55.527633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.525644 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576cfeec-a543-4ee3-9187-d4101c6034a1" path="/var/lib/kubelet/pods/576cfeec-a543-4ee3-9187-d4101c6034a1/volumes" Jun 08 15:38:55.672842 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.672749 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" event={"ID":"4560d8f3-c6ce-477a-aaff-4c544734ccab","Type":"ContainerStarted","Data":"60e32c9f3bf77af512c3f366cc3651277990b081549ac0c9da0cb78f9f784f97"} Jun 08 15:38:55.675636 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"71cb2430b6c1f813bc3d4f0b0831aa1d5d2b52d6b359c8790b56e4a5176f6e20"} Jun 08 15:38:55.675759 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"11ea6be48af9cdf416844aec33bc70cea4018099ffbf327fba11110dfc74c5ec"} Jun 08 15:38:55.675759 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"5c7b76d18b0e985c4490a710c9cc7e0387bc1aa3c8d772b250f7de911f448689"} Jun 08 15:38:55.675828 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675759 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"3160ddb4797daf49cb21aa4e8ce4ab8dc6e13217109473d2c506574524ec72d7"} Jun 08 15:38:55.675828 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675801 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"700d30540eae695cb94afb63def984eb6faab24b0f39ddd37bcc38554b007a7d"} Jun 08 15:38:55.675887 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.675836 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f4abe462-1e03-4d20-858c-c4670f7357ba","Type":"ContainerStarted","Data":"7bd270ff12d919cda5fc5e548317745357b49e43b606ab3a5a2c34be8953c667"} Jun 08 15:38:55.704147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:55.704100 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.688337082 podStartE2EDuration="2.704085006s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.747924ms" isStatefulPod=false podCreationTimestamp="2026-06-08 15:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:38:55.701733377 +0000 UTC m=+308.642184695" watchObservedRunningTime="2026-06-08 15:38:55.704085006 +0000 UTC m=+308.644536336" Jun 08 15:38:57.685873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:57.685762 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" event={"ID":"4560d8f3-c6ce-477a-aaff-4c544734ccab","Type":"ContainerStarted","Data":"bb5e91153c8d0c91177be3c5eb5702434be0a2bb448c37bacde9621a0e953841"} Jun 08 15:38:57.685873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:57.685846 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" event={"ID":"4560d8f3-c6ce-477a-aaff-4c544734ccab","Type":"ContainerStarted","Data":"6955e2c22b6a8e5d0668b1cb6b029abee89a22873b225affc023a42db77db42a"} Jun 08 15:38:57.685873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:57.685866 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" event={"ID":"4560d8f3-c6ce-477a-aaff-4c544734ccab","Type":"ContainerStarted","Data":"0786bd8576b34d000ac6c33c4342b529815893a5084b56ee245be5f11e37929b"} Jun 08 15:38:57.714037 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:38:57.713988 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-644b997c57-c6mtb" podStartSLOduration=1.756069751 podStartE2EDuration="3.713973764s" totalImagesPullingTime="1.957904013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:38:57.711875292 +0000 UTC m=+310.652326599" watchObservedRunningTime="2026-06-08 15:38:57.713973764 +0000 UTC m=+310.654425060" Jun 08 15:39:04.129797 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.129733 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b6c6bd8c5-v9kc5" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" containerID="cri-o://7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e" gracePeriod=15 Jun 08 15:39:04.367796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.367774 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:39:04.427377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427287 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427325 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbcvb\" (UniqueName: \"kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427362 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427383 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427739 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427400 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427739 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427518 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config\") pod \"af093e76-8aa6-4d1a-a386-3e1bafe38761\" (UID: \"af093e76-8aa6-4d1a-a386-3e1bafe38761\") " Jun 08 15:39:04.427843 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427760 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config" (OuterVolumeSpecName: "console-config") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:39:04.427843 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427789 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca" (OuterVolumeSpecName: "service-ca") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:39:04.427843 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.427797 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:39:04.429657 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.429628 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:39:04.429777 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.429688 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb" (OuterVolumeSpecName: "kube-api-access-hbcvb") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "kube-api-access-hbcvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:39:04.429860 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.429840 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af093e76-8aa6-4d1a-a386-3e1bafe38761" (UID: "af093e76-8aa6-4d1a-a386-3e1bafe38761"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:39:04.528586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528542 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-serving-cert\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.528586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528578 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbcvb\" (UniqueName: \"kubernetes.io/projected/af093e76-8aa6-4d1a-a386-3e1bafe38761-kube-api-access-hbcvb\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.528586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528593 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-oauth-serving-cert\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.528857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528630 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-config\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.528857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528643 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af093e76-8aa6-4d1a-a386-3e1bafe38761-service-ca\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.528857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.528655 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af093e76-8aa6-4d1a-a386-3e1bafe38761-console-oauth-config\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:39:04.711889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.711798 2553 generic.go:356] "Generic (PLEG): container finished" podID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerID="7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e" exitCode=0 Jun 08 15:39:04.711889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.711843 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6c6bd8c5-v9kc5" Jun 08 15:39:04.711889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.711851 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6c6bd8c5-v9kc5" event={"ID":"af093e76-8aa6-4d1a-a386-3e1bafe38761","Type":"ContainerDied","Data":"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e"} Jun 08 15:39:04.712117 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.711902 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6c6bd8c5-v9kc5" event={"ID":"af093e76-8aa6-4d1a-a386-3e1bafe38761","Type":"ContainerDied","Data":"ec49c804b6eb0ebaeb76f5ee908c1ae87d055ca097c8d1e38368760410ef756a"} Jun 08 15:39:04.712117 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.711924 2553 scope.go:117] "RemoveContainer" containerID="7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e" Jun 08 15:39:04.721159 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.721135 2553 scope.go:117] "RemoveContainer" containerID="7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e" Jun 08 15:39:04.721429 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:39:04.721407 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e\": container with ID starting with 7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e not found: ID does not exist" containerID="7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e" Jun 08 15:39:04.721484 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.721438 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e"} err="failed to get container status \"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e\": rpc error: code = NotFound desc = could not find container \"7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e\": container with ID starting with 7e0b805b28e5831a69dfef7121e85a52e9b0546fe2a3d6fec29233200837e11e not found: ID does not exist" Jun 08 15:39:04.733715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.733685 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:39:04.739424 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:04.739396 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6c6bd8c5-v9kc5"] Jun 08 15:39:05.528719 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:39:05.528689 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" path="/var/lib/kubelet/pods/af093e76-8aa6-4d1a-a386-3e1bafe38761/volumes" Jun 08 15:43:18.819975 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.819937 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj"] Jun 08 15:43:18.820432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.820189 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" Jun 08 15:43:18.820432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.820200 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" Jun 08 15:43:18.820432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.820241 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="af093e76-8aa6-4d1a-a386-3e1bafe38761" containerName="console" Jun 08 15:43:18.822994 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.822979 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:18.826217 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.826192 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 15:43:18.827707 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.827684 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 15:43:18.827838 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.827745 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7l9mr\"" Jun 08 15:43:18.839614 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.839574 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj"] Jun 08 15:43:18.982224 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.982185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kn8r\" (UniqueName: \"kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:18.982396 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.982234 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:18.982396 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:18.982255 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.083335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.083251 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kn8r\" (UniqueName: \"kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.083335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.083298 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.083335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.083324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.083687 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.083667 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.083735 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.083688 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.092380 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.092350 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kn8r\" (UniqueName: \"kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.131216 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.131193 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:19.260549 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.260522 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj"] Jun 08 15:43:19.262436 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:43:19.262404 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe835e4_54d8_4c4e_ba60_d603bb2e521f.slice/crio-4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b WatchSource:0}: Error finding container 4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b: Status 404 returned error can't find the container with id 4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b Jun 08 15:43:19.586491 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:19.586452 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" event={"ID":"cfe835e4-54d8-4c4e-ba60-d603bb2e521f","Type":"ContainerStarted","Data":"4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b"} Jun 08 15:43:27.617298 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:27.617262 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerID="e3aa508c2514f926f7efe283115a7fbe3a5220d9c137b589701f8e3d544ef652" exitCode=0 Jun 08 15:43:27.617762 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:27.617350 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" event={"ID":"cfe835e4-54d8-4c4e-ba60-d603bb2e521f","Type":"ContainerDied","Data":"e3aa508c2514f926f7efe283115a7fbe3a5220d9c137b589701f8e3d544ef652"} Jun 08 15:43:29.626396 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:29.626362 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerID="a6df1a696ad41345bc11eda481cc704935ddb9cf235b004cab08c0eaa41c883a" exitCode=0 Jun 08 15:43:29.626787 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:29.626439 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" event={"ID":"cfe835e4-54d8-4c4e-ba60-d603bb2e521f","Type":"ContainerDied","Data":"a6df1a696ad41345bc11eda481cc704935ddb9cf235b004cab08c0eaa41c883a"} Jun 08 15:43:36.659229 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:36.659192 2553 generic.go:356] "Generic (PLEG): container finished" podID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerID="6890ad6a68561b550c9faf0eecc22b5e5494926066b42f59dfa9551806482551" exitCode=0 Jun 08 15:43:36.659587 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:36.659270 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" event={"ID":"cfe835e4-54d8-4c4e-ba60-d603bb2e521f","Type":"ContainerDied","Data":"6890ad6a68561b550c9faf0eecc22b5e5494926066b42f59dfa9551806482551"} Jun 08 15:43:37.781711 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.781682 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:37.823333 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.823302 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util\") pod \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " Jun 08 15:43:37.823467 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.823350 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kn8r\" (UniqueName: \"kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r\") pod \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " Jun 08 15:43:37.823467 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.823387 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle\") pod \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\" (UID: \"cfe835e4-54d8-4c4e-ba60-d603bb2e521f\") " Jun 08 15:43:37.824054 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.824032 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle" (OuterVolumeSpecName: "bundle") pod "cfe835e4-54d8-4c4e-ba60-d603bb2e521f" (UID: "cfe835e4-54d8-4c4e-ba60-d603bb2e521f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:43:37.825517 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.825501 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r" (OuterVolumeSpecName: "kube-api-access-9kn8r") pod "cfe835e4-54d8-4c4e-ba60-d603bb2e521f" (UID: "cfe835e4-54d8-4c4e-ba60-d603bb2e521f"). InnerVolumeSpecName "kube-api-access-9kn8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:43:37.828055 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.828033 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util" (OuterVolumeSpecName: "util") pod "cfe835e4-54d8-4c4e-ba60-d603bb2e521f" (UID: "cfe835e4-54d8-4c4e-ba60-d603bb2e521f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:43:37.924322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.924239 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-util\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:43:37.924322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.924268 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kn8r\" (UniqueName: \"kubernetes.io/projected/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-kube-api-access-9kn8r\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:43:37.924322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:37.924280 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfe835e4-54d8-4c4e-ba60-d603bb2e521f-bundle\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:43:38.668149 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:38.668114 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" event={"ID":"cfe835e4-54d8-4c4e-ba60-d603bb2e521f","Type":"ContainerDied","Data":"4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b"} Jun 08 15:43:38.668320 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:38.668161 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4029bdf3eeb36d72884c56f865932d2ff9704401a4f9d1b7c0d7700de26d4c3b" Jun 08 15:43:38.668320 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:38.668160 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqdkdj" Jun 08 15:43:41.517213 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517170 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh"] Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517543 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="util" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517560 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="util" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517578 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="pull" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517585 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="pull" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517616 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="extract" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517634 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="extract" Jun 08 15:43:41.517713 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.517702 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe835e4-54d8-4c4e-ba60-d603bb2e521f" containerName="extract" Jun 08 15:43:41.561292 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.561251 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh"] Jun 08 15:43:41.561430 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.561354 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.564714 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.564685 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 15:43:41.564859 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.564750 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:43:41.564859 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.564773 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f68jq\"" Jun 08 15:43:41.651682 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.651647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxh8\" (UniqueName: \"kubernetes.io/projected/68693dcb-fe37-454b-a693-2aae2f0cfbb4-kube-api-access-vlxh8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.651837 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.651707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68693dcb-fe37-454b-a693-2aae2f0cfbb4-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.752554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.752525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68693dcb-fe37-454b-a693-2aae2f0cfbb4-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.752737 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.752573 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxh8\" (UniqueName: \"kubernetes.io/projected/68693dcb-fe37-454b-a693-2aae2f0cfbb4-kube-api-access-vlxh8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.752920 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.752900 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68693dcb-fe37-454b-a693-2aae2f0cfbb4-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.761696 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.761669 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxh8\" (UniqueName: \"kubernetes.io/projected/68693dcb-fe37-454b-a693-2aae2f0cfbb4-kube-api-access-vlxh8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2x7sh\" (UID: \"68693dcb-fe37-454b-a693-2aae2f0cfbb4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:41.872394 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:41.872318 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" Jun 08 15:43:42.025636 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:42.025588 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh"] Jun 08 15:43:42.029385 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:43:42.029358 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68693dcb_fe37_454b_a693_2aae2f0cfbb4.slice/crio-dbe7a65d606bbf2a9be6e9cce536eb10a372d5acc7256ea6b85e346847392236 WatchSource:0}: Error finding container dbe7a65d606bbf2a9be6e9cce536eb10a372d5acc7256ea6b85e346847392236: Status 404 returned error can't find the container with id dbe7a65d606bbf2a9be6e9cce536eb10a372d5acc7256ea6b85e346847392236 Jun 08 15:43:42.682897 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:42.682867 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" event={"ID":"68693dcb-fe37-454b-a693-2aae2f0cfbb4","Type":"ContainerStarted","Data":"dbe7a65d606bbf2a9be6e9cce536eb10a372d5acc7256ea6b85e346847392236"} Jun 08 15:43:45.698962 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:45.698910 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" event={"ID":"68693dcb-fe37-454b-a693-2aae2f0cfbb4","Type":"ContainerStarted","Data":"58963d06905dcba2bf8103a48c0c7d1188ac8c12e80b7e00f868a91ca600a9d2"} Jun 08 15:43:45.724937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:45.724869 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2x7sh" podStartSLOduration=1.853016207 podStartE2EDuration="4.72484772s" totalImagesPullingTime="2.871831513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:43:45.721233504 +0000 UTC m=+598.661684800" watchObservedRunningTime="2026-06-08 15:43:45.72484772 +0000 UTC m=+598.665299018" Jun 08 15:43:47.501411 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:47.501382 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:43:47.501872 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:43:47.501386 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:44:16.611548 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.611469 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58"] Jun 08 15:44:16.613361 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.613347 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.616522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.616497 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:44:16.616522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.616519 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 15:44:16.618044 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.618028 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zzmcf\"" Jun 08 15:44:16.623228 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.623208 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58"] Jun 08 15:44:16.722573 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.722537 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmdd\" (UniqueName: \"kubernetes.io/projected/a27895b2-d957-43fd-8e6d-fdb996e15991-kube-api-access-qtmdd\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.722573 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.722572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27895b2-d957-43fd-8e6d-fdb996e15991-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.823725 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.823688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmdd\" (UniqueName: \"kubernetes.io/projected/a27895b2-d957-43fd-8e6d-fdb996e15991-kube-api-access-qtmdd\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.823725 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.823724 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27895b2-d957-43fd-8e6d-fdb996e15991-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.824110 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.824095 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27895b2-d957-43fd-8e6d-fdb996e15991-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.833187 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.833160 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmdd\" (UniqueName: \"kubernetes.io/projected/a27895b2-d957-43fd-8e6d-fdb996e15991-kube-api-access-qtmdd\") pod \"openshift-lws-operator-fd8ccff4c-ptv58\" (UID: \"a27895b2-d957-43fd-8e6d-fdb996e15991\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:16.922461 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:16.922367 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" Jun 08 15:44:17.051574 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:17.051542 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58"] Jun 08 15:44:17.054086 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:17.054050 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda27895b2_d957_43fd_8e6d_fdb996e15991.slice/crio-d53fef15f7db07e850754775b225d81e85ba0311ca7a2d7861398bc842b5e4be WatchSource:0}: Error finding container d53fef15f7db07e850754775b225d81e85ba0311ca7a2d7861398bc842b5e4be: Status 404 returned error can't find the container with id d53fef15f7db07e850754775b225d81e85ba0311ca7a2d7861398bc842b5e4be Jun 08 15:44:17.055523 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:17.055507 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 15:44:17.813471 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:17.813440 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" event={"ID":"a27895b2-d957-43fd-8e6d-fdb996e15991","Type":"ContainerStarted","Data":"d53fef15f7db07e850754775b225d81e85ba0311ca7a2d7861398bc842b5e4be"} Jun 08 15:44:20.829724 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:20.829689 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" event={"ID":"a27895b2-d957-43fd-8e6d-fdb996e15991","Type":"ContainerStarted","Data":"ea922d55a41d8ab77a98f424bed31c322e57e9fcd7c78c60e80f06c8f173c8c1"} Jun 08 15:44:20.847373 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:20.847326 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptv58" podStartSLOduration=1.8976774440000002 podStartE2EDuration="4.847309527s" totalImagesPullingTime="2.949632083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:44:20.845956257 +0000 UTC m=+633.786407562" watchObservedRunningTime="2026-06-08 15:44:20.847309527 +0000 UTC m=+633.787760824" Jun 08 15:44:24.224459 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.224425 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv"] Jun 08 15:44:24.227817 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.227801 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.230662 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.230644 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 15:44:24.232123 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.232104 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 15:44:24.232222 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.232104 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7l9mr\"" Jun 08 15:44:24.235887 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.235868 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv"] Jun 08 15:44:24.388791 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.388759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.388997 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.388859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6nz\" (UniqueName: \"kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.388997 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.388900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.490143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.490061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6nz\" (UniqueName: \"kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.490143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.490100 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.490143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.490126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.490533 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.490510 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.490533 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.490523 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.498632 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.498583 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6nz\" (UniqueName: \"kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.537532 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.537508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:24.661020 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.660989 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv"] Jun 08 15:44:24.663249 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:24.663224 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfad477_4272_422c_a6f2_b152b79b341a.slice/crio-ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514 WatchSource:0}: Error finding container ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514: Status 404 returned error can't find the container with id ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514 Jun 08 15:44:24.849727 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.849694 2553 generic.go:356] "Generic (PLEG): container finished" podID="1bfad477-4272-422c-a6f2-b152b79b341a" containerID="47993eec47cf71a85d2fafd67b128a1b90d2525212c5411e09ebe3e5acc7e99a" exitCode=0 Jun 08 15:44:24.849889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.849772 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" event={"ID":"1bfad477-4272-422c-a6f2-b152b79b341a","Type":"ContainerDied","Data":"47993eec47cf71a85d2fafd67b128a1b90d2525212c5411e09ebe3e5acc7e99a"} Jun 08 15:44:24.849889 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:24.849827 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" event={"ID":"1bfad477-4272-422c-a6f2-b152b79b341a","Type":"ContainerStarted","Data":"ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514"} Jun 08 15:44:25.855709 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:25.855673 2553 generic.go:356] "Generic (PLEG): container finished" podID="1bfad477-4272-422c-a6f2-b152b79b341a" containerID="33da888c324cb62d3177d2cbd8d187ed419fe29969b0adc33de3c65843729311" exitCode=0 Jun 08 15:44:25.856048 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:25.855744 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" event={"ID":"1bfad477-4272-422c-a6f2-b152b79b341a","Type":"ContainerDied","Data":"33da888c324cb62d3177d2cbd8d187ed419fe29969b0adc33de3c65843729311"} Jun 08 15:44:26.862284 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:26.862251 2553 generic.go:356] "Generic (PLEG): container finished" podID="1bfad477-4272-422c-a6f2-b152b79b341a" containerID="76443009512c5de70b3e5069dcec791f2c51724d24100c7d78f7c02aba0de00a" exitCode=0 Jun 08 15:44:26.862681 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:26.862329 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" event={"ID":"1bfad477-4272-422c-a6f2-b152b79b341a","Type":"ContainerDied","Data":"76443009512c5de70b3e5069dcec791f2c51724d24100c7d78f7c02aba0de00a"} Jun 08 15:44:27.134145 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.134061 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5df5b6c9-q466b"] Jun 08 15:44:27.137214 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.137198 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.140683 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.140662 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 15:44:27.140788 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.140682 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8p72b\"" Jun 08 15:44:27.140973 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.140957 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 15:44:27.142185 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.142164 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 15:44:27.142546 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.142519 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 15:44:27.142854 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.142838 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 15:44:27.146625 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.146589 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 15:44:27.150181 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.150163 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5df5b6c9-q466b"] Jun 08 15:44:27.213017 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.212983 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-service-ca\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213017 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213016 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-oauth-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213259 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213045 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-console-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213259 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213069 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jcn\" (UniqueName: \"kubernetes.io/projected/00f54810-adc3-4745-85b6-2b66c792c165-kube-api-access-t4jcn\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213259 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-trusted-ca-bundle\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213259 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213179 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-oauth-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.213259 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.213213 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314471 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314432 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-oauth-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314471 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-console-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jcn\" (UniqueName: \"kubernetes.io/projected/00f54810-adc3-4745-85b6-2b66c792c165-kube-api-access-t4jcn\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314535 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-trusted-ca-bundle\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314619 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-oauth-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314657 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.314896 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.314705 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-service-ca\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.315329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.315292 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-console-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.315465 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.315330 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-oauth-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.315465 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.315365 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-service-ca\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.315539 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.315457 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00f54810-adc3-4745-85b6-2b66c792c165-trusted-ca-bundle\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.317176 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.317150 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-oauth-config\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.317251 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.317225 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00f54810-adc3-4745-85b6-2b66c792c165-console-serving-cert\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.322950 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.322925 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jcn\" (UniqueName: \"kubernetes.io/projected/00f54810-adc3-4745-85b6-2b66c792c165-kube-api-access-t4jcn\") pod \"console-6f5df5b6c9-q466b\" (UID: \"00f54810-adc3-4745-85b6-2b66c792c165\") " pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.446508 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.446416 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:27.580443 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.580412 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5df5b6c9-q466b"] Jun 08 15:44:27.582035 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:27.582009 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f54810_adc3_4745_85b6_2b66c792c165.slice/crio-b9f685acfe38de825c707b3aa848f0c433dceefda822439bba05a3ddc2035038 WatchSource:0}: Error finding container b9f685acfe38de825c707b3aa848f0c433dceefda822439bba05a3ddc2035038: Status 404 returned error can't find the container with id b9f685acfe38de825c707b3aa848f0c433dceefda822439bba05a3ddc2035038 Jun 08 15:44:27.868010 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.867970 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5df5b6c9-q466b" event={"ID":"00f54810-adc3-4745-85b6-2b66c792c165","Type":"ContainerStarted","Data":"35ddbbc64350d734d96091442158b470d6adb35ef0e901f4fe18b42c2493e9f1"} Jun 08 15:44:27.868393 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.868021 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5df5b6c9-q466b" event={"ID":"00f54810-adc3-4745-85b6-2b66c792c165","Type":"ContainerStarted","Data":"b9f685acfe38de825c707b3aa848f0c433dceefda822439bba05a3ddc2035038"} Jun 08 15:44:27.888512 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.888465 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5df5b6c9-q466b" podStartSLOduration=0.888447194 podStartE2EDuration="888.447194ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:44:27.886774647 +0000 UTC m=+640.827225944" watchObservedRunningTime="2026-06-08 15:44:27.888447194 +0000 UTC m=+640.828898489" Jun 08 15:44:27.980640 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:27.980614 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:28.021291 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.021263 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util\") pod \"1bfad477-4272-422c-a6f2-b152b79b341a\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " Jun 08 15:44:28.021457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.021308 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle\") pod \"1bfad477-4272-422c-a6f2-b152b79b341a\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " Jun 08 15:44:28.021457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.021351 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh6nz\" (UniqueName: \"kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz\") pod \"1bfad477-4272-422c-a6f2-b152b79b341a\" (UID: \"1bfad477-4272-422c-a6f2-b152b79b341a\") " Jun 08 15:44:28.022180 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.022154 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle" (OuterVolumeSpecName: "bundle") pod "1bfad477-4272-422c-a6f2-b152b79b341a" (UID: "1bfad477-4272-422c-a6f2-b152b79b341a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:44:28.023608 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.023572 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz" (OuterVolumeSpecName: "kube-api-access-wh6nz") pod "1bfad477-4272-422c-a6f2-b152b79b341a" (UID: "1bfad477-4272-422c-a6f2-b152b79b341a"). InnerVolumeSpecName "kube-api-access-wh6nz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:44:28.027145 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.027100 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util" (OuterVolumeSpecName: "util") pod "1bfad477-4272-422c-a6f2-b152b79b341a" (UID: "1bfad477-4272-422c-a6f2-b152b79b341a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:44:28.122623 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.122488 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh6nz\" (UniqueName: \"kubernetes.io/projected/1bfad477-4272-422c-a6f2-b152b79b341a-kube-api-access-wh6nz\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:44:28.122623 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.122535 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-util\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:44:28.122623 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.122546 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bfad477-4272-422c-a6f2-b152b79b341a-bundle\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:44:28.876045 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.874308 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" event={"ID":"1bfad477-4272-422c-a6f2-b152b79b341a","Type":"ContainerDied","Data":"ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514"} Jun 08 15:44:28.876045 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.874340 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9qdxv" Jun 08 15:44:28.876045 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:28.874398 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca86af6be47df718ac30a4af0c381dd2e527a39d2702a6c7ec807ebb1dc27514" Jun 08 15:44:36.299379 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299342 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw"] Jun 08 15:44:36.299876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299840 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="extract" Jun 08 15:44:36.299876 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299859 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="extract" Jun 08 15:44:36.299985 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299882 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="util" Jun 08 15:44:36.299985 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299891 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="util" Jun 08 15:44:36.299985 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299914 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="pull" Jun 08 15:44:36.299985 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299923 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="pull" Jun 08 15:44:36.300178 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.299986 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bfad477-4272-422c-a6f2-b152b79b341a" containerName="extract" Jun 08 15:44:36.302019 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.301998 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.305202 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.305181 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 15:44:36.305319 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.305299 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 15:44:36.305388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.305298 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 15:44:36.305388 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.305300 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 15:44:36.305691 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.305674 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dskpq\"" Jun 08 15:44:36.318323 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.318302 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw"] Jun 08 15:44:36.384911 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.384876 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-manifests\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.385089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.384933 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-tmp\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.385089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.385000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfff\" (UniqueName: \"kubernetes.io/projected/dc609bec-cf18-4258-a302-adea168ab501-kube-api-access-6mfff\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.385089 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.385047 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-webhook-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.385194 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.385102 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.485960 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.485927 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-tmp\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.486132 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.485973 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfff\" (UniqueName: \"kubernetes.io/projected/dc609bec-cf18-4258-a302-adea168ab501-kube-api-access-6mfff\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.486132 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.485993 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-webhook-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.486132 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.486019 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.486285 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.486192 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-manifests\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.486539 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.486513 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-manifests\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.488436 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.488402 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc609bec-cf18-4258-a302-adea168ab501-tmp\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.488552 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.488489 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.488633 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.488566 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc609bec-cf18-4258-a302-adea168ab501-webhook-cert\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.496529 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.496508 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfff\" (UniqueName: \"kubernetes.io/projected/dc609bec-cf18-4258-a302-adea168ab501-kube-api-access-6mfff\") pod \"opendatahub-operator-controller-manager-6484fb6dbf-4pkzw\" (UID: \"dc609bec-cf18-4258-a302-adea168ab501\") " pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.611651 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.611549 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:36.740790 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.740766 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw"] Jun 08 15:44:36.743174 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:36.743145 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc609bec_cf18_4258_a302_adea168ab501.slice/crio-3e1878072ebeb39fb8f5f25c9d3ce0a42c22022caab16bcaff19d442c197a8a7 WatchSource:0}: Error finding container 3e1878072ebeb39fb8f5f25c9d3ce0a42c22022caab16bcaff19d442c197a8a7: Status 404 returned error can't find the container with id 3e1878072ebeb39fb8f5f25c9d3ce0a42c22022caab16bcaff19d442c197a8a7 Jun 08 15:44:36.909812 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:36.909725 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" event={"ID":"dc609bec-cf18-4258-a302-adea168ab501","Type":"ContainerStarted","Data":"3e1878072ebeb39fb8f5f25c9d3ce0a42c22022caab16bcaff19d442c197a8a7"} Jun 08 15:44:37.447411 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:37.447375 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:37.447870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:37.447444 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:37.453203 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:37.453178 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:37.920964 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:37.920893 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5df5b6c9-q466b" Jun 08 15:44:39.926869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:39.926777 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" event={"ID":"dc609bec-cf18-4258-a302-adea168ab501","Type":"ContainerStarted","Data":"6689935de9ec9c0e3c120945218bb5e74314d451dbc2825ca707de114105d4e3"} Jun 08 15:44:40.932588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:40.932497 2553 generic.go:356] "Generic (PLEG): container finished" podID="dc609bec-cf18-4258-a302-adea168ab501" containerID="6689935de9ec9c0e3c120945218bb5e74314d451dbc2825ca707de114105d4e3" exitCode=0 Jun 08 15:44:40.932588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:40.932561 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" event={"ID":"dc609bec-cf18-4258-a302-adea168ab501","Type":"ContainerDied","Data":"6689935de9ec9c0e3c120945218bb5e74314d451dbc2825ca707de114105d4e3"} Jun 08 15:44:41.937937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:41.937897 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" event={"ID":"dc609bec-cf18-4258-a302-adea168ab501","Type":"ContainerStarted","Data":"39a6ab2f23ada8606369ac678235e418482f1e6b1e4d47a8a7439d524ab88a54"} Jun 08 15:44:41.938387 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:41.938015 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:41.961858 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:41.961809 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" podStartSLOduration=1.9246553899999999 podStartE2EDuration="5.961793778s" totalImagesPullingTime="3.119618576s" totalInitContainerRuntime="917.519812ms" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:44:41.959575639 +0000 UTC m=+654.900026956" watchObservedRunningTime="2026-06-08 15:44:41.961793778 +0000 UTC m=+654.902245073" Jun 08 15:44:52.944056 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:52.944022 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6484fb6dbf-4pkzw" Jun 08 15:44:56.111734 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.111697 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74547644b9-p4rqr"] Jun 08 15:44:56.119316 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.119298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.124958 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.124937 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 15:44:56.125200 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.125182 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 15:44:56.125586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.125567 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 15:44:56.126480 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.126461 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 15:44:56.137641 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.137619 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74547644b9-p4rqr"] Jun 08 15:44:56.261963 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.261928 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333dbc83-4405-4c9c-957d-87bff245e370-tls-certs\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.262146 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.262059 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333dbc83-4405-4c9c-957d-87bff245e370-tmp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.262146 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.262111 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqbp\" (UniqueName: \"kubernetes.io/projected/333dbc83-4405-4c9c-957d-87bff245e370-kube-api-access-rnqbp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.265133 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.265107 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rvjwj"] Jun 08 15:44:56.267721 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.267701 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.271645 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.271623 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 15:44:56.271803 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.271649 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-z9cj6\"" Jun 08 15:44:56.286202 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.286176 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rvjwj"] Jun 08 15:44:56.362610 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.362507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333dbc83-4405-4c9c-957d-87bff245e370-tmp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.362610 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.362559 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqbp\" (UniqueName: \"kubernetes.io/projected/333dbc83-4405-4c9c-957d-87bff245e370-kube-api-access-rnqbp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.362857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.362621 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.362857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.362652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333dbc83-4405-4c9c-957d-87bff245e370-tls-certs\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.362857 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.362694 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2c8\" (UniqueName: \"kubernetes.io/projected/890d7cac-6e7e-4856-a924-055264362ac0-kube-api-access-5q2c8\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.365005 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.364975 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/333dbc83-4405-4c9c-957d-87bff245e370-tmp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.365117 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.365051 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/333dbc83-4405-4c9c-957d-87bff245e370-tls-certs\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.378844 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.378816 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqbp\" (UniqueName: \"kubernetes.io/projected/333dbc83-4405-4c9c-957d-87bff245e370-kube-api-access-rnqbp\") pod \"kube-auth-proxy-74547644b9-p4rqr\" (UID: \"333dbc83-4405-4c9c-957d-87bff245e370\") " pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.429466 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.429431 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" Jun 08 15:44:56.463784 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.463747 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.463952 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.463816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2c8\" (UniqueName: \"kubernetes.io/projected/890d7cac-6e7e-4856-a924-055264362ac0-kube-api-access-5q2c8\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.463952 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:44:56.463926 2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 15:44:56.464025 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:44:56.464017 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert podName:890d7cac-6e7e-4856-a924-055264362ac0 nodeName:}" failed. No retries permitted until 2026-06-08 15:44:56.963995198 +0000 UTC m=+669.904446472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert") pod "odh-model-controller-6dc94f689f-rvjwj" (UID: "890d7cac-6e7e-4856-a924-055264362ac0") : secret "odh-model-controller-webhook-cert" not found Jun 08 15:44:56.473834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.473806 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2c8\" (UniqueName: \"kubernetes.io/projected/890d7cac-6e7e-4856-a924-055264362ac0-kube-api-access-5q2c8\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.584831 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.584796 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74547644b9-p4rqr"] Jun 08 15:44:56.587159 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:56.587123 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333dbc83_4405_4c9c_957d_87bff245e370.slice/crio-df8e448789bac9c1be50f340f15d9517a7c15ce466b29bcc3c82764be5aa4d3f WatchSource:0}: Error finding container df8e448789bac9c1be50f340f15d9517a7c15ce466b29bcc3c82764be5aa4d3f: Status 404 returned error can't find the container with id df8e448789bac9c1be50f340f15d9517a7c15ce466b29bcc3c82764be5aa4d3f Jun 08 15:44:56.969012 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.968981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:56.971501 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:56.971476 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/890d7cac-6e7e-4856-a924-055264362ac0-cert\") pod \"odh-model-controller-6dc94f689f-rvjwj\" (UID: \"890d7cac-6e7e-4856-a924-055264362ac0\") " pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:57.002447 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.002414 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" event={"ID":"333dbc83-4405-4c9c-957d-87bff245e370","Type":"ContainerStarted","Data":"df8e448789bac9c1be50f340f15d9517a7c15ce466b29bcc3c82764be5aa4d3f"} Jun 08 15:44:57.056569 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.056533 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-klchf"] Jun 08 15:44:57.059897 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.059877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.062791 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.062770 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 15:44:57.069513 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.069484 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-klchf"] Jun 08 15:44:57.171157 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.171111 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.171673 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.171186 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfz5x\" (UniqueName: \"kubernetes.io/projected/01ed415a-6076-4403-abec-108307175465-kube-api-access-mfz5x\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.186072 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.186040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:44:57.272846 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.272051 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.272846 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.272158 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfz5x\" (UniqueName: \"kubernetes.io/projected/01ed415a-6076-4403-abec-108307175465-kube-api-access-mfz5x\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.272846 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:44:57.272513 2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 08 15:44:57.272846 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:44:57.272584 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs podName:01ed415a-6076-4403-abec-108307175465 nodeName:}" failed. No retries permitted until 2026-06-08 15:44:57.772562602 +0000 UTC m=+670.713013877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs") pod "model-serving-api-5dd488fc48-klchf" (UID: "01ed415a-6076-4403-abec-108307175465") : secret "model-serving-api-tls" not found Jun 08 15:44:57.283187 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.283149 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfz5x\" (UniqueName: \"kubernetes.io/projected/01ed415a-6076-4403-abec-108307175465-kube-api-access-mfz5x\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.335567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.335511 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-rvjwj"] Jun 08 15:44:57.338241 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:57.338208 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890d7cac_6e7e_4856_a924_055264362ac0.slice/crio-1756da8ee1139b28f12ae486c22c8b7afec114fa2a974671556aaae7b6b9f96c WatchSource:0}: Error finding container 1756da8ee1139b28f12ae486c22c8b7afec114fa2a974671556aaae7b6b9f96c: Status 404 returned error can't find the container with id 1756da8ee1139b28f12ae486c22c8b7afec114fa2a974671556aaae7b6b9f96c Jun 08 15:44:57.775520 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.775488 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.778411 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.778385 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ed415a-6076-4403-abec-108307175465-tls-certs\") pod \"model-serving-api-5dd488fc48-klchf\" (UID: \"01ed415a-6076-4403-abec-108307175465\") " pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.782309 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.782283 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq"] Jun 08 15:44:57.786017 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.785914 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.788914 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.788894 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7l9mr\"" Jun 08 15:44:57.789023 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.788977 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 15:44:57.790618 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.790330 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 15:44:57.796674 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.795906 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq"] Jun 08 15:44:57.876358 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.876318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q46zf\" (UniqueName: \"kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.876567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.876380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.876567 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.876424 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.972413 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.972370 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:44:57.977662 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.977632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q46zf\" (UniqueName: \"kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.977797 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.977695 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.977797 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.977738 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.978122 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.978100 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.978693 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.978663 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:57.989356 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:57.989242 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q46zf\" (UniqueName: \"kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:58.013484 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:58.013400 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" event={"ID":"890d7cac-6e7e-4856-a924-055264362ac0","Type":"ContainerStarted","Data":"1756da8ee1139b28f12ae486c22c8b7afec114fa2a974671556aaae7b6b9f96c"} Jun 08 15:44:58.102509 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:58.102459 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:44:58.156219 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:58.156144 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-klchf"] Jun 08 15:44:58.159214 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:58.159157 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ed415a_6076_4403_abec_108307175465.slice/crio-05800db3aae3241f375807f3b0292ac87fb7f5fe8351991ae23948df7191c43f WatchSource:0}: Error finding container 05800db3aae3241f375807f3b0292ac87fb7f5fe8351991ae23948df7191c43f: Status 404 returned error can't find the container with id 05800db3aae3241f375807f3b0292ac87fb7f5fe8351991ae23948df7191c43f Jun 08 15:44:58.282554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:58.282002 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq"] Jun 08 15:44:59.021380 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:44:59.021311 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-klchf" event={"ID":"01ed415a-6076-4403-abec-108307175465","Type":"ContainerStarted","Data":"05800db3aae3241f375807f3b0292ac87fb7f5fe8351991ae23948df7191c43f"} Jun 08 15:44:59.231548 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:44:59.231512 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630c60ee_9f36_4a81_b1e4_22cb48426896.slice/crio-d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d WatchSource:0}: Error finding container d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d: Status 404 returned error can't find the container with id d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d Jun 08 15:45:00.027896 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:00.027842 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" event={"ID":"630c60ee-9f36-4a81-b1e4-22cb48426896","Type":"ContainerStarted","Data":"d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d"} Jun 08 15:45:02.037900 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.037867 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" event={"ID":"333dbc83-4405-4c9c-957d-87bff245e370","Type":"ContainerStarted","Data":"92cc58428d507c3d66604fb45adb9672cccc93b03293c642e7f76e081310e5e6"} Jun 08 15:45:02.039380 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.039357 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-klchf" event={"ID":"01ed415a-6076-4403-abec-108307175465","Type":"ContainerStarted","Data":"94b48c79b5518eb40f2528207ac7d966c52a9b947c50d64048a6ee7090d4ed0c"} Jun 08 15:45:02.039489 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.039461 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:45:02.040710 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.040691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" event={"ID":"890d7cac-6e7e-4856-a924-055264362ac0","Type":"ContainerStarted","Data":"6382945ad0bc200089babcdb9b4b9f0eafd489613ad7bdc8d3ee2cdd4849f999"} Jun 08 15:45:02.040788 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.040749 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:45:02.042180 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.042162 2553 generic.go:356] "Generic (PLEG): container finished" podID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerID="b56b7e3fb1653bb8ed4c60a6621671366077ccb41ca2997182344cabd5ccbb71" exitCode=0 Jun 08 15:45:02.042258 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.042182 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" event={"ID":"630c60ee-9f36-4a81-b1e4-22cb48426896","Type":"ContainerDied","Data":"b56b7e3fb1653bb8ed4c60a6621671366077ccb41ca2997182344cabd5ccbb71"} Jun 08 15:45:02.056057 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.056013 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74547644b9-p4rqr" podStartSLOduration=1.093251636 podStartE2EDuration="6.055996749s" totalImagesPullingTime="4.962745113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:02.053750324 +0000 UTC m=+674.994201620" watchObservedRunningTime="2026-06-08 15:45:02.055996749 +0000 UTC m=+674.996448047" Jun 08 15:45:02.071250 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.071177 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-klchf" podStartSLOduration=1.67611536 podStartE2EDuration="5.07115833s" totalImagesPullingTime="3.39504297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:02.070162114 +0000 UTC m=+675.010613410" watchObservedRunningTime="2026-06-08 15:45:02.07115833 +0000 UTC m=+675.011609627" Jun 08 15:45:02.089621 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:02.089553 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" podStartSLOduration=1.863841187 podStartE2EDuration="6.089536679s" totalImagesPullingTime="4.225695492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:02.089005825 +0000 UTC m=+675.029457115" watchObservedRunningTime="2026-06-08 15:45:02.089536679 +0000 UTC m=+675.029987974" Jun 08 15:45:04.053071 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:04.053036 2553 generic.go:356] "Generic (PLEG): container finished" podID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerID="f664f38d55d2e294dbb5ba9ad42b4761464db3e1bbed9ea494698b92c5116876" exitCode=0 Jun 08 15:45:04.053071 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:04.053075 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" event={"ID":"630c60ee-9f36-4a81-b1e4-22cb48426896","Type":"ContainerDied","Data":"f664f38d55d2e294dbb5ba9ad42b4761464db3e1bbed9ea494698b92c5116876"} Jun 08 15:45:05.059298 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:05.059262 2553 generic.go:356] "Generic (PLEG): container finished" podID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerID="e53d0de6943a9bc982d07d0a9fc13ab931d4b56079fb6bb2bae6a822e7333513" exitCode=0 Jun 08 15:45:05.059703 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:05.059348 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" event={"ID":"630c60ee-9f36-4a81-b1e4-22cb48426896","Type":"ContainerDied","Data":"e53d0de6943a9bc982d07d0a9fc13ab931d4b56079fb6bb2bae6a822e7333513"} Jun 08 15:45:06.203174 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.203145 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:45:06.355374 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.355274 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util\") pod \"630c60ee-9f36-4a81-b1e4-22cb48426896\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " Jun 08 15:45:06.355374 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.355315 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle\") pod \"630c60ee-9f36-4a81-b1e4-22cb48426896\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " Jun 08 15:45:06.355623 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.355380 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q46zf\" (UniqueName: \"kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf\") pod \"630c60ee-9f36-4a81-b1e4-22cb48426896\" (UID: \"630c60ee-9f36-4a81-b1e4-22cb48426896\") " Jun 08 15:45:06.356233 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.356203 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle" (OuterVolumeSpecName: "bundle") pod "630c60ee-9f36-4a81-b1e4-22cb48426896" (UID: "630c60ee-9f36-4a81-b1e4-22cb48426896"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:45:06.357488 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.357460 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf" (OuterVolumeSpecName: "kube-api-access-q46zf") pod "630c60ee-9f36-4a81-b1e4-22cb48426896" (UID: "630c60ee-9f36-4a81-b1e4-22cb48426896"). InnerVolumeSpecName "kube-api-access-q46zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:45:06.360755 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.360730 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util" (OuterVolumeSpecName: "util") pod "630c60ee-9f36-4a81-b1e4-22cb48426896" (UID: "630c60ee-9f36-4a81-b1e4-22cb48426896"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:45:06.456002 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.455936 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-util\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:06.456002 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.455968 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/630c60ee-9f36-4a81-b1e4-22cb48426896-bundle\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:06.456002 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.455981 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q46zf\" (UniqueName: \"kubernetes.io/projected/630c60ee-9f36-4a81-b1e4-22cb48426896-kube-api-access-q46zf\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:06.965360 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965322 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4bjf7"] Jun 08 15:45:06.965793 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965775 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="extract" Jun 08 15:45:06.965869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965796 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="extract" Jun 08 15:45:06.965869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965825 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="util" Jun 08 15:45:06.965869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965833 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="util" Jun 08 15:45:06.965869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965853 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="pull" Jun 08 15:45:06.965869 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965863 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="pull" Jun 08 15:45:06.966011 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.965941 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="630c60ee-9f36-4a81-b1e4-22cb48426896" containerName="extract" Jun 08 15:45:06.969279 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.969260 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4"] Jun 08 15:45:06.969408 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.969390 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:06.972589 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.972566 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:06.972715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.972651 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 15:45:06.972715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.972704 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-k7522\"" Jun 08 15:45:06.975952 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.975929 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 15:45:06.976972 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.976952 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-znr88\"" Jun 08 15:45:06.982507 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.982481 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4"] Jun 08 15:45:06.985055 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:06.984987 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4bjf7"] Jun 08 15:45:07.060509 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.060471 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h4br\" (UniqueName: \"kubernetes.io/projected/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-kube-api-access-4h4br\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.060708 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.060538 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.070996 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.070963 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" event={"ID":"630c60ee-9f36-4a81-b1e4-22cb48426896","Type":"ContainerDied","Data":"d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d"} Jun 08 15:45:07.070996 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.070990 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pdhhq" Jun 08 15:45:07.071173 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.071012 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5a650f7aff354904d425d4d4b664f76f686f3da99fb79ba683daf4b05d30f0d" Jun 08 15:45:07.161346 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.161305 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h4br\" (UniqueName: \"kubernetes.io/projected/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-kube-api-access-4h4br\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.161510 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.161358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q98c\" (UniqueName: \"kubernetes.io/projected/31b2f637-b8cc-4630-863e-f853575e87b6-kube-api-access-5q98c\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.161510 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.161411 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31b2f637-b8cc-4630-863e-f853575e87b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.161510 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.161447 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.161686 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:45:07.161513 2553 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 08 15:45:07.161686 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:45:07.161579 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert podName:eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab nodeName:}" failed. No retries permitted until 2026-06-08 15:45:07.661558052 +0000 UTC m=+680.602009327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert") pod "kserve-controller-manager-69fc866d76-4bjf7" (UID: "eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab") : secret "kserve-webhook-server-cert" not found Jun 08 15:45:07.188029 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.188003 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h4br\" (UniqueName: \"kubernetes.io/projected/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-kube-api-access-4h4br\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.263120 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.263019 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q98c\" (UniqueName: \"kubernetes.io/projected/31b2f637-b8cc-4630-863e-f853575e87b6-kube-api-access-5q98c\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.263120 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.263085 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31b2f637-b8cc-4630-863e-f853575e87b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.265591 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.265569 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31b2f637-b8cc-4630-863e-f853575e87b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.272179 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.272150 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q98c\" (UniqueName: \"kubernetes.io/projected/31b2f637-b8cc-4630-863e-f853575e87b6-kube-api-access-5q98c\") pod \"llmisvc-controller-manager-864bfd7bc9-8thf4\" (UID: \"31b2f637-b8cc-4630-863e-f853575e87b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.288758 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.288727 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:07.420549 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.420524 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4"] Jun 08 15:45:07.421901 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:07.421873 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod31b2f637_b8cc_4630_863e_f853575e87b6.slice/crio-5c41ce38bc52523bdcfa7cbcce53b54c6d21922b713fe5c914310d36e0aaaedb WatchSource:0}: Error finding container 5c41ce38bc52523bdcfa7cbcce53b54c6d21922b713fe5c914310d36e0aaaedb: Status 404 returned error can't find the container with id 5c41ce38bc52523bdcfa7cbcce53b54c6d21922b713fe5c914310d36e0aaaedb Jun 08 15:45:07.667327 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.667283 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.669647 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.669624 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab-cert\") pod \"kserve-controller-manager-69fc866d76-4bjf7\" (UID: \"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:07.882686 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:07.882656 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:08.084305 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:08.084243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" event={"ID":"31b2f637-b8cc-4630-863e-f853575e87b6","Type":"ContainerStarted","Data":"5c41ce38bc52523bdcfa7cbcce53b54c6d21922b713fe5c914310d36e0aaaedb"} Jun 08 15:45:08.128035 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:08.128002 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4bjf7"] Jun 08 15:45:08.191164 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:08.191131 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0fb28c_2f86_43f5_93de_ebebf7ffc9ab.slice/crio-7fdf76c92a6d1ae53074bf2da3cce3be2925af03588cb997a81fa52b970d482d WatchSource:0}: Error finding container 7fdf76c92a6d1ae53074bf2da3cce3be2925af03588cb997a81fa52b970d482d: Status 404 returned error can't find the container with id 7fdf76c92a6d1ae53074bf2da3cce3be2925af03588cb997a81fa52b970d482d Jun 08 15:45:09.089161 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:09.089125 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" event={"ID":"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab","Type":"ContainerStarted","Data":"7fdf76c92a6d1ae53074bf2da3cce3be2925af03588cb997a81fa52b970d482d"} Jun 08 15:45:12.106890 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.106847 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" event={"ID":"31b2f637-b8cc-4630-863e-f853575e87b6","Type":"ContainerStarted","Data":"163b61c87fc0f1c0c853f1b905f973dedd2c33fbed54fe410e248803d7911ecd"} Jun 08 15:45:12.107466 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.106981 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:12.108318 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.108294 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" event={"ID":"eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab","Type":"ContainerStarted","Data":"10982f470a4d60343ebc6f1a536129d006e73042bad0d647235b8537f6136445"} Jun 08 15:45:12.108435 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.108420 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:12.126027 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.125961 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" podStartSLOduration=1.881726838 podStartE2EDuration="6.125945676s" totalImagesPullingTime="4.244218838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:12.125681151 +0000 UTC m=+685.066132444" watchObservedRunningTime="2026-06-08 15:45:12.125945676 +0000 UTC m=+685.066396973" Jun 08 15:45:12.144329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:12.144280 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" podStartSLOduration=2.664736305 podStartE2EDuration="6.144264552s" totalImagesPullingTime="3.479528247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:12.14315519 +0000 UTC m=+685.083606486" watchObservedRunningTime="2026-06-08 15:45:12.144264552 +0000 UTC m=+685.084715870" Jun 08 15:45:13.048932 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:13.048903 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-rvjwj" Jun 08 15:45:13.050755 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:13.050732 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-klchf" Jun 08 15:45:18.480163 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.480126 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8"] Jun 08 15:45:18.483779 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.483762 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.486766 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.486739 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 15:45:18.486879 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.486739 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7l9mr\"" Jun 08 15:45:18.486879 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.486742 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 15:45:18.492321 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.492295 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8"] Jun 08 15:45:18.556957 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.556926 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.557129 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.556994 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhj2r\" (UniqueName: \"kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.557129 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.557052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.657692 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.657659 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.657872 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.657732 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhj2r\" (UniqueName: \"kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.657872 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.657763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.658062 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.658041 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.658102 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.658066 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.667334 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.667307 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhj2r\" (UniqueName: \"kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.793451 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.793411 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:18.934482 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:18.934456 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8"] Jun 08 15:45:18.936330 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:18.936302 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8afc092_864b_46b4_a72a_a297ce12fad6.slice/crio-8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a WatchSource:0}: Error finding container 8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a: Status 404 returned error can't find the container with id 8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a Jun 08 15:45:19.143834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:19.143738 2553 generic.go:356] "Generic (PLEG): container finished" podID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerID="631620ba3850c114ca77b4b3034b7fbf1145a68c15fea1578df5a6c90f4f6120" exitCode=0 Jun 08 15:45:19.143834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:19.143826 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" event={"ID":"d8afc092-864b-46b4-a72a-a297ce12fad6","Type":"ContainerDied","Data":"631620ba3850c114ca77b4b3034b7fbf1145a68c15fea1578df5a6c90f4f6120"} Jun 08 15:45:19.144017 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:19.143877 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" event={"ID":"d8afc092-864b-46b4-a72a-a297ce12fad6","Type":"ContainerStarted","Data":"8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a"} Jun 08 15:45:20.150236 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.150197 2553 generic.go:356] "Generic (PLEG): container finished" podID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerID="d6f06e64ab65a479f8093e734e657f28835351e07efb6e399c0bd41e463d5c0e" exitCode=0 Jun 08 15:45:20.150697 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.150280 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" event={"ID":"d8afc092-864b-46b4-a72a-a297ce12fad6","Type":"ContainerDied","Data":"d6f06e64ab65a479f8093e734e657f28835351e07efb6e399c0bd41e463d5c0e"} Jun 08 15:45:20.763486 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.763454 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt"] Jun 08 15:45:20.766779 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.766764 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.769865 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.769840 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 15:45:20.769865 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.769860 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-dxp2c\"" Jun 08 15:45:20.770007 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.769860 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 15:45:20.775329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.775306 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5j8x\" (UniqueName: \"kubernetes.io/projected/4ac96ba5-16f7-488c-897b-d937ec0764c5-kube-api-access-t5j8x\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.775432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.775362 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4ac96ba5-16f7-488c-897b-d937ec0764c5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.785702 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.785675 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt"] Jun 08 15:45:20.876834 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.876796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5j8x\" (UniqueName: \"kubernetes.io/projected/4ac96ba5-16f7-488c-897b-d937ec0764c5-kube-api-access-t5j8x\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.877000 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.876845 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4ac96ba5-16f7-488c-897b-d937ec0764c5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.879554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.879528 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4ac96ba5-16f7-488c-897b-d937ec0764c5-operator-config\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:20.886992 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:20.886972 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5j8x\" (UniqueName: \"kubernetes.io/projected/4ac96ba5-16f7-488c-897b-d937ec0764c5-kube-api-access-t5j8x\") pod \"servicemesh-operator3-57f65f65fb-nlgdt\" (UID: \"4ac96ba5-16f7-488c-897b-d937ec0764c5\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:21.076035 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:21.075996 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:21.157447 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:21.157413 2553 generic.go:356] "Generic (PLEG): container finished" podID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerID="57adb68d2e215d93dcb9b3f578d8f26bdff066d7ca7ae72e78bae4ce788ab94c" exitCode=0 Jun 08 15:45:21.157824 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:21.157494 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" event={"ID":"d8afc092-864b-46b4-a72a-a297ce12fad6","Type":"ContainerDied","Data":"57adb68d2e215d93dcb9b3f578d8f26bdff066d7ca7ae72e78bae4ce788ab94c"} Jun 08 15:45:21.219879 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:21.219855 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt"] Jun 08 15:45:21.221765 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:21.221731 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac96ba5_16f7_488c_897b_d937ec0764c5.slice/crio-6d5fb43276c91ae08f5352a227e795b4fb8dad6e139c4438fb513e0ee5b87659 WatchSource:0}: Error finding container 6d5fb43276c91ae08f5352a227e795b4fb8dad6e139c4438fb513e0ee5b87659: Status 404 returned error can't find the container with id 6d5fb43276c91ae08f5352a227e795b4fb8dad6e139c4438fb513e0ee5b87659 Jun 08 15:45:22.167402 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.167065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" event={"ID":"4ac96ba5-16f7-488c-897b-d937ec0764c5","Type":"ContainerStarted","Data":"6d5fb43276c91ae08f5352a227e795b4fb8dad6e139c4438fb513e0ee5b87659"} Jun 08 15:45:22.321192 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.321166 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:22.389291 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.389037 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle\") pod \"d8afc092-864b-46b4-a72a-a297ce12fad6\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " Jun 08 15:45:22.389291 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.389124 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util\") pod \"d8afc092-864b-46b4-a72a-a297ce12fad6\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " Jun 08 15:45:22.389291 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.389162 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhj2r\" (UniqueName: \"kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r\") pod \"d8afc092-864b-46b4-a72a-a297ce12fad6\" (UID: \"d8afc092-864b-46b4-a72a-a297ce12fad6\") " Jun 08 15:45:22.390528 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.390483 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle" (OuterVolumeSpecName: "bundle") pod "d8afc092-864b-46b4-a72a-a297ce12fad6" (UID: "d8afc092-864b-46b4-a72a-a297ce12fad6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:45:22.392731 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.392701 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r" (OuterVolumeSpecName: "kube-api-access-zhj2r") pod "d8afc092-864b-46b4-a72a-a297ce12fad6" (UID: "d8afc092-864b-46b4-a72a-a297ce12fad6"). InnerVolumeSpecName "kube-api-access-zhj2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:45:22.397981 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.397941 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util" (OuterVolumeSpecName: "util") pod "d8afc092-864b-46b4-a72a-a297ce12fad6" (UID: "d8afc092-864b-46b4-a72a-a297ce12fad6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:45:22.490849 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.490760 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-bundle\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:22.490849 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.490794 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8afc092-864b-46b4-a72a-a297ce12fad6-util\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:22.490849 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:22.490808 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhj2r\" (UniqueName: \"kubernetes.io/projected/d8afc092-864b-46b4-a72a-a297ce12fad6-kube-api-access-zhj2r\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:45:23.174076 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:23.174045 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" event={"ID":"d8afc092-864b-46b4-a72a-a297ce12fad6","Type":"ContainerDied","Data":"8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a"} Jun 08 15:45:23.174076 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:23.174090 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c7e7a6bb40c3528fa63bd1a3b8890aca7df1719c49d0ef7aaecb120b9901b1a" Jun 08 15:45:23.174578 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:23.174096 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acdgj8" Jun 08 15:45:24.180797 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:24.180760 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" event={"ID":"4ac96ba5-16f7-488c-897b-d937ec0764c5","Type":"ContainerStarted","Data":"a3a920509d2db4c40dbf1964d6dba8e805a7853971b82431782f7a8907a196a9"} Jun 08 15:45:24.181265 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:24.180878 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:24.204339 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:24.204288 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" podStartSLOduration=1.791554043 podStartE2EDuration="4.204271421s" totalImagesPullingTime="2.412717378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:24.201731704 +0000 UTC m=+697.142183010" watchObservedRunningTime="2026-06-08 15:45:24.204271421 +0000 UTC m=+697.144722716" Jun 08 15:45:26.506082 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506043 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7b4d846984-q5kcj"] Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506377 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="pull" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506389 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="pull" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506403 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="util" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506409 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="util" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506421 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="extract" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506428 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="extract" Jun 08 15:45:26.506522 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.506486 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8afc092-864b-46b4-a72a-a297ce12fad6" containerName="extract" Jun 08 15:45:26.509592 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.509567 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.512789 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.512769 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dpflj\"" Jun 08 15:45:26.512902 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.512786 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 15:45:26.518330 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.518232 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b4d846984-q5kcj"] Jun 08 15:45:26.529361 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.529333 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl6f4\" (UniqueName: \"kubernetes.io/projected/ae947b5b-c717-4d05-96c9-89e0c6288001-kube-api-access-nl6f4\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.529515 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.529429 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ae947b5b-c717-4d05-96c9-89e0c6288001-redirect-config\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.630430 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.630397 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ae947b5b-c717-4d05-96c9-89e0c6288001-redirect-config\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.630665 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.630454 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl6f4\" (UniqueName: \"kubernetes.io/projected/ae947b5b-c717-4d05-96c9-89e0c6288001-kube-api-access-nl6f4\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.631174 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.631148 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ae947b5b-c717-4d05-96c9-89e0c6288001-redirect-config\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.640053 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.640028 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl6f4\" (UniqueName: \"kubernetes.io/projected/ae947b5b-c717-4d05-96c9-89e0c6288001-kube-api-access-nl6f4\") pod \"dashboard-redirect-7b4d846984-q5kcj\" (UID: \"ae947b5b-c717-4d05-96c9-89e0c6288001\") " pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.822332 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.822302 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" Jun 08 15:45:26.951193 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:26.951166 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b4d846984-q5kcj"] Jun 08 15:45:26.952911 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:26.952887 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae947b5b_c717_4d05_96c9_89e0c6288001.slice/crio-d40aeb772c92deed45cc147f01aec5b09803cf1078a2bb7888358ae377298e6e WatchSource:0}: Error finding container d40aeb772c92deed45cc147f01aec5b09803cf1078a2bb7888358ae377298e6e: Status 404 returned error can't find the container with id d40aeb772c92deed45cc147f01aec5b09803cf1078a2bb7888358ae377298e6e Jun 08 15:45:27.201489 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:27.201397 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" event={"ID":"ae947b5b-c717-4d05-96c9-89e0c6288001","Type":"ContainerStarted","Data":"d40aeb772c92deed45cc147f01aec5b09803cf1078a2bb7888358ae377298e6e"} Jun 08 15:45:30.219892 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:30.219813 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" event={"ID":"ae947b5b-c717-4d05-96c9-89e0c6288001","Type":"ContainerStarted","Data":"278d5c7da93e69a6e387a630db3653835f916e3ce7bd81f566718dbc0c57cd5c"} Jun 08 15:45:30.238511 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:30.238463 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7b4d846984-q5kcj" podStartSLOduration=1.879915596 podStartE2EDuration="4.23844729s" totalImagesPullingTime="2.358531694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:30.238221284 +0000 UTC m=+703.178672580" watchObservedRunningTime="2026-06-08 15:45:30.23844729 +0000 UTC m=+703.178898585" Jun 08 15:45:35.192239 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:35.192207 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-nlgdt" Jun 08 15:45:43.115485 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:43.115451 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8thf4" Jun 08 15:45:43.118560 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:43.118537 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4bjf7" Jun 08 15:45:47.948441 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.948404 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf"] Jun 08 15:45:47.957053 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.957031 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:47.960383 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.960177 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 15:45:47.960383 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.960233 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 15:45:47.960383 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.960250 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 15:45:47.960383 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.960265 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mlgf4\"" Jun 08 15:45:47.960724 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.960591 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 15:45:47.964754 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:47.964721 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf"] Jun 08 15:45:48.021230 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021410 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021239 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e742b3-3a25-4df4-a488-c4c886fcab2c-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021410 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021333 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021410 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021410 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021392 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021456 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2fbt\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-kube-api-access-v2fbt\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.021554 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.021501 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122234 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122201 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122247 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122268 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122291 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2fbt\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-kube-api-access-v2fbt\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122433 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122417 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122463 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.122699 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122495 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e742b3-3a25-4df4-a488-c4c886fcab2c-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.123072 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.122972 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.124848 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.124827 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.125185 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.125167 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.125286 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.125184 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e742b3-3a25-4df4-a488-c4c886fcab2c-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.125286 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.125207 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c2e742b3-3a25-4df4-a488-c4c886fcab2c-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.131182 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.131151 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2fbt\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-kube-api-access-v2fbt\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.131380 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.131362 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e742b3-3a25-4df4-a488-c4c886fcab2c-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nmcnf\" (UID: \"c2e742b3-3a25-4df4-a488-c4c886fcab2c\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.267521 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.267492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:48.398376 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:48.398347 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf"] Jun 08 15:45:48.399528 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:45:48.399500 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e742b3_3a25_4df4_a488_c4c886fcab2c.slice/crio-15ea723493cd26f3c7ab24e4dabc3c5a623772a82b23e347e2c8f04d7be72a3e WatchSource:0}: Error finding container 15ea723493cd26f3c7ab24e4dabc3c5a623772a82b23e347e2c8f04d7be72a3e: Status 404 returned error can't find the container with id 15ea723493cd26f3c7ab24e4dabc3c5a623772a82b23e347e2c8f04d7be72a3e Jun 08 15:45:49.319214 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:49.319165 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" event={"ID":"c2e742b3-3a25-4df4-a488-c4c886fcab2c","Type":"ContainerStarted","Data":"15ea723493cd26f3c7ab24e4dabc3c5a623772a82b23e347e2c8f04d7be72a3e"} Jun 08 15:45:51.969042 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:51.969006 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 15:45:51.969290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:51.969074 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 15:45:52.336638 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:52.336587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" event={"ID":"c2e742b3-3a25-4df4-a488-c4c886fcab2c","Type":"ContainerStarted","Data":"99d1150141b18d23af4aa5892d4aca018a57a464bbacd3c3f8bfb032a0d91428"} Jun 08 15:45:52.336858 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:52.336657 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:45:52.360513 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:52.360448 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" podStartSLOduration=1.793460574 podStartE2EDuration="5.360434215s" totalImagesPullingTime="3.566973641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:52.358380913 +0000 UTC m=+725.298832239" watchObservedRunningTime="2026-06-08 15:45:52.360434215 +0000 UTC m=+725.300885511" Jun 08 15:45:53.345491 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:53.345451 2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-nmcnf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 08 15:45:53.345992 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:53.345507 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" podUID="c2e742b3-3a25-4df4-a488-c4c886fcab2c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 15:45:56.344346 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:45:56.344307 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nmcnf" Jun 08 15:46:42.402480 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.402420 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn"] Jun 08 15:46:42.408796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.408765 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:42.413691 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.413666 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 15:46:42.413938 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.413669 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 15:46:42.414032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.413700 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 15:46:42.414090 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.413758 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wkbkj\"" Jun 08 15:46:42.416243 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.416218 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn"] Jun 08 15:46:42.481727 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.481686 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hh4\" (UniqueName: \"kubernetes.io/projected/219025da-b6ce-4610-92b9-e748618d1e7a-kube-api-access-v4hh4\") pod \"dns-operator-controller-manager-864dd78c4c-p92gn\" (UID: \"219025da-b6ce-4610-92b9-e748618d1e7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:42.582498 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.582458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hh4\" (UniqueName: \"kubernetes.io/projected/219025da-b6ce-4610-92b9-e748618d1e7a-kube-api-access-v4hh4\") pod \"dns-operator-controller-manager-864dd78c4c-p92gn\" (UID: \"219025da-b6ce-4610-92b9-e748618d1e7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:42.592438 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.592400 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hh4\" (UniqueName: \"kubernetes.io/projected/219025da-b6ce-4610-92b9-e748618d1e7a-kube-api-access-v4hh4\") pod \"dns-operator-controller-manager-864dd78c4c-p92gn\" (UID: \"219025da-b6ce-4610-92b9-e748618d1e7a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:42.722121 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.722029 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:42.863590 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:42.863565 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn"] Jun 08 15:46:42.865587 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:46:42.865552 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219025da_b6ce_4610_92b9_e748618d1e7a.slice/crio-139a9174388ef113474d5cafc2f26e7a78cf98dd9d3321d39e6e42d261c55c98 WatchSource:0}: Error finding container 139a9174388ef113474d5cafc2f26e7a78cf98dd9d3321d39e6e42d261c55c98: Status 404 returned error can't find the container with id 139a9174388ef113474d5cafc2f26e7a78cf98dd9d3321d39e6e42d261c55c98 Jun 08 15:46:43.581473 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:43.581432 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" event={"ID":"219025da-b6ce-4610-92b9-e748618d1e7a","Type":"ContainerStarted","Data":"139a9174388ef113474d5cafc2f26e7a78cf98dd9d3321d39e6e42d261c55c98"} Jun 08 15:46:45.593426 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:45.593387 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" event={"ID":"219025da-b6ce-4610-92b9-e748618d1e7a","Type":"ContainerStarted","Data":"9b4b7ce7c22a0efa54e1bf96bec2e3557e1462273c59d296ebc2f5ae69305c02"} Jun 08 15:46:45.593837 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:45.593526 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:45.612909 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:45.612850 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" podStartSLOduration=1.443210286 podStartE2EDuration="3.61283149s" totalImagesPullingTime="2.169621204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:46:45.612526903 +0000 UTC m=+778.552978191" watchObservedRunningTime="2026-06-08 15:46:45.61283149 +0000 UTC m=+778.553282787" Jun 08 15:46:56.103120 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.103059 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx"] Jun 08 15:46:56.108558 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.108534 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.111883 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.111862 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v2p9l\"" Jun 08 15:46:56.120855 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.120812 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx"] Jun 08 15:46:56.208992 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.208954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54tb\" (UniqueName: \"kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.209155 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.209064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.309799 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.309763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.309963 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.309821 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54tb\" (UniqueName: \"kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.310163 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.310142 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.318611 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.318578 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54tb\" (UniqueName: \"kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb\") pod \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.398659 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.398558 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx"] Jun 08 15:46:56.398873 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.398860 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:56.405350 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.405325 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx"] Jun 08 15:46:56.422021 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.421346 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:46:56.425509 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.425489 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.437710 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.437687 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:46:56.512234 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.512201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c9d4\" (UniqueName: \"kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.512234 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.512248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.600755 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.600727 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p92gn" Jun 08 15:46:56.612779 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.612755 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c9d4\" (UniqueName: \"kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.612901 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.612789 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.613108 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.613092 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.626131 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.626109 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c9d4\" (UniqueName: \"kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4\") pod \"kuadrant-operator-controller-manager-55467d9f7-d48cf\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.736979 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.736900 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:46:56.878676 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:56.878650 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:46:56.880651 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:46:56.880628 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83c4ce2_0098_419b_aaf9_9dbce0df33c4.slice/crio-02a47c29d187e20f44919a6d0d12fee31203c59d4365074eee00acbef01b9280 WatchSource:0}: Error finding container 02a47c29d187e20f44919a6d0d12fee31203c59d4365074eee00acbef01b9280: Status 404 returned error can't find the container with id 02a47c29d187e20f44919a6d0d12fee31203c59d4365074eee00acbef01b9280 Jun 08 15:46:57.654763 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:57.654723 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" event={"ID":"a83c4ce2-0098-419b-aaf9-9dbce0df33c4","Type":"ContainerStarted","Data":"02a47c29d187e20f44919a6d0d12fee31203c59d4365074eee00acbef01b9280"} Jun 08 15:46:58.950427 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:46:58.950387 2553 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-wnwqx_kuadrant-system_65850435-c8ac-4d0d-8883-8d8b87c7cba7_0(4270f213b73acfdde644687d606a86e92ec7498bc8603c85f1f623f2f2a5545e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-wnwqx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 08 15:46:58.950771 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:46:58.950456 2553 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-wnwqx_kuadrant-system_65850435-c8ac-4d0d-8883-8d8b87c7cba7_0(4270f213b73acfdde644687d606a86e92ec7498bc8603c85f1f623f2f2a5545e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-wnwqx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:59.664584 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.664554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:59.674381 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.674355 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:59.677134 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:46:59.677103 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" is forbidden: User \"system:node:ip-10-0-141-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-19.ec2.internal' and this object" podUID="65850435-c8ac-4d0d-8883-8d8b87c7cba7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:46:59.844842 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.844763 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume\") pod \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " Jun 08 15:46:59.844842 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.844832 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d54tb\" (UniqueName: \"kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb\") pod \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\" (UID: \"65850435-c8ac-4d0d-8883-8d8b87c7cba7\") " Jun 08 15:46:59.845096 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.845070 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65850435-c8ac-4d0d-8883-8d8b87c7cba7" (UID: "65850435-c8ac-4d0d-8883-8d8b87c7cba7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:46:59.846955 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.846929 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb" (OuterVolumeSpecName: "kube-api-access-d54tb") pod "65850435-c8ac-4d0d-8883-8d8b87c7cba7" (UID: "65850435-c8ac-4d0d-8883-8d8b87c7cba7"). InnerVolumeSpecName "kube-api-access-d54tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:46:59.946329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.946251 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65850435-c8ac-4d0d-8883-8d8b87c7cba7-extensions-socket-volume\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:46:59.946329 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:46:59.946282 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d54tb\" (UniqueName: \"kubernetes.io/projected/65850435-c8ac-4d0d-8883-8d8b87c7cba7-kube-api-access-d54tb\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:47:00.669700 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:00.669665 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:47:00.672655 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:47:00.672616 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" is forbidden: User \"system:node:ip-10-0-141-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-19.ec2.internal' and this object" podUID="65850435-c8ac-4d0d-8883-8d8b87c7cba7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:47:00.679663 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:47:00.679632 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-wnwqx\" is forbidden: User \"system:node:ip-10-0-141-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-19.ec2.internal' and this object" podUID="65850435-c8ac-4d0d-8883-8d8b87c7cba7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wnwqx" Jun 08 15:47:01.526589 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:01.526557 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65850435-c8ac-4d0d-8883-8d8b87c7cba7" path="/var/lib/kubelet/pods/65850435-c8ac-4d0d-8883-8d8b87c7cba7/volumes" Jun 08 15:47:01.676512 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:01.676472 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" event={"ID":"a83c4ce2-0098-419b-aaf9-9dbce0df33c4","Type":"ContainerStarted","Data":"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba"} Jun 08 15:47:01.676943 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:01.676634 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:47:01.699877 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:01.699827 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" podStartSLOduration=1.413227234 podStartE2EDuration="5.699811333s" totalImagesPullingTime="4.286584099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:47:01.698222517 +0000 UTC m=+794.638673813" watchObservedRunningTime="2026-06-08 15:47:01.699811333 +0000 UTC m=+794.640262699" Jun 08 15:47:12.683523 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.683489 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:47:12.941649 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.941550 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 15:47:12.945343 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.945321 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:12.958855 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.958826 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:12.958994 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.958888 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtz7q\" (UniqueName: \"kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:12.959574 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:12.959552 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 15:47:13.060226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.060196 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.060392 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.060269 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtz7q\" (UniqueName: \"kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.060558 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.060539 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.088290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.088263 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtz7q\" (UniqueName: \"kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q\") pod \"kuadrant-operator-controller-manager-86878c769f-llw9g\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.255796 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.255704 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.384144 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.384112 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 15:47:13.385753 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:47:13.385723 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5deed1db_b329_47df_9bc7_3cbaf2c5f4c6.slice/crio-37dffa3e5cb007082a605375fa30f5aa7288b1f6963cc99b166be9de29c395b5 WatchSource:0}: Error finding container 37dffa3e5cb007082a605375fa30f5aa7288b1f6963cc99b166be9de29c395b5: Status 404 returned error can't find the container with id 37dffa3e5cb007082a605375fa30f5aa7288b1f6963cc99b166be9de29c395b5 Jun 08 15:47:13.737755 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.737721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" event={"ID":"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6","Type":"ContainerStarted","Data":"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02"} Jun 08 15:47:13.738145 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.737778 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" event={"ID":"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6","Type":"ContainerStarted","Data":"37dffa3e5cb007082a605375fa30f5aa7288b1f6963cc99b166be9de29c395b5"} Jun 08 15:47:13.738145 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.737816 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:13.761147 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:13.761095 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" podStartSLOduration=1.7610790010000001 podStartE2EDuration="1.761079001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:47:13.759350562 +0000 UTC m=+806.699801858" watchObservedRunningTime="2026-06-08 15:47:13.761079001 +0000 UTC m=+806.701530296" Jun 08 15:47:24.745623 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:24.745571 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 15:47:24.799023 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:24.798991 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:47:24.799252 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:24.799212 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" podUID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" containerName="manager" containerID="cri-o://ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba" gracePeriod=10 Jun 08 15:47:25.046128 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.046099 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:47:25.172705 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.172672 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume\") pod \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " Jun 08 15:47:25.172874 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.172795 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c9d4\" (UniqueName: \"kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4\") pod \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\" (UID: \"a83c4ce2-0098-419b-aaf9-9dbce0df33c4\") " Jun 08 15:47:25.173237 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.173210 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a83c4ce2-0098-419b-aaf9-9dbce0df33c4" (UID: "a83c4ce2-0098-419b-aaf9-9dbce0df33c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:47:25.175032 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.175007 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4" (OuterVolumeSpecName: "kube-api-access-8c9d4") pod "a83c4ce2-0098-419b-aaf9-9dbce0df33c4" (UID: "a83c4ce2-0098-419b-aaf9-9dbce0df33c4"). InnerVolumeSpecName "kube-api-access-8c9d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:47:25.274113 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.274077 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c9d4\" (UniqueName: \"kubernetes.io/projected/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-kube-api-access-8c9d4\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:47:25.274113 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.274107 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a83c4ce2-0098-419b-aaf9-9dbce0df33c4-extensions-socket-volume\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 15:47:25.797438 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.797406 2553 generic.go:356] "Generic (PLEG): container finished" podID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" containerID="ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba" exitCode=0 Jun 08 15:47:25.797937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.797448 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" Jun 08 15:47:25.797937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.797498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" event={"ID":"a83c4ce2-0098-419b-aaf9-9dbce0df33c4","Type":"ContainerDied","Data":"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba"} Jun 08 15:47:25.797937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.797563 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf" event={"ID":"a83c4ce2-0098-419b-aaf9-9dbce0df33c4","Type":"ContainerDied","Data":"02a47c29d187e20f44919a6d0d12fee31203c59d4365074eee00acbef01b9280"} Jun 08 15:47:25.797937 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.797622 2553 scope.go:117] "RemoveContainer" containerID="ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba" Jun 08 15:47:25.806884 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.806715 2553 scope.go:117] "RemoveContainer" containerID="ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba" Jun 08 15:47:25.807046 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:47:25.806966 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba\": container with ID starting with ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba not found: ID does not exist" containerID="ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba" Jun 08 15:47:25.807046 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.807000 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba"} err="failed to get container status \"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba\": rpc error: code = NotFound desc = could not find container \"ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba\": container with ID starting with ccfae90e5b382cb72140b73afe63208fa301a28930d1fce3c3d936a867246dba not found: ID does not exist" Jun 08 15:47:25.819146 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.819119 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:47:25.825225 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:25.825203 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d48cf"] Jun 08 15:47:27.524934 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:27.524901 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" path="/var/lib/kubelet/pods/a83c4ce2-0098-419b-aaf9-9dbce0df33c4/volumes" Jun 08 15:47:41.232965 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.232925 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:47:41.233457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.233270 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" containerName="manager" Jun 08 15:47:41.233457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.233281 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" containerName="manager" Jun 08 15:47:41.233457 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.233401 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a83c4ce2-0098-419b-aaf9-9dbce0df33c4" containerName="manager" Jun 08 15:47:41.235508 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.235488 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.238265 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.238240 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 15:47:41.238370 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.238293 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gwhc2\"" Jun 08 15:47:41.245667 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.245645 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:47:41.277715 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.277687 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:47:41.421576 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.421543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29e25473-1c92-42ff-b28c-be893332f5e1-config-file\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.421785 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.421621 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5rgp\" (UniqueName: \"kubernetes.io/projected/29e25473-1c92-42ff-b28c-be893332f5e1-kube-api-access-j5rgp\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.522098 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.522064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5rgp\" (UniqueName: \"kubernetes.io/projected/29e25473-1c92-42ff-b28c-be893332f5e1-kube-api-access-j5rgp\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.522276 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.522168 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29e25473-1c92-42ff-b28c-be893332f5e1-config-file\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.522802 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.522777 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29e25473-1c92-42ff-b28c-be893332f5e1-config-file\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.530387 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.530366 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5rgp\" (UniqueName: \"kubernetes.io/projected/29e25473-1c92-42ff-b28c-be893332f5e1-kube-api-access-j5rgp\") pod \"limitador-limitador-54d6d988d5-kwm8q\" (UID: \"29e25473-1c92-42ff-b28c-be893332f5e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.546921 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.546901 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:41.682090 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.682062 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:47:41.684098 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:47:41.684068 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e25473_1c92_42ff_b28c_be893332f5e1.slice/crio-86ee2d6d058af54b2988da8dac50da8b0c51c3da5e6c0b152637c407adbfcf32 WatchSource:0}: Error finding container 86ee2d6d058af54b2988da8dac50da8b0c51c3da5e6c0b152637c407adbfcf32: Status 404 returned error can't find the container with id 86ee2d6d058af54b2988da8dac50da8b0c51c3da5e6c0b152637c407adbfcf32 Jun 08 15:47:41.883446 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:41.883366 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" event={"ID":"29e25473-1c92-42ff-b28c-be893332f5e1","Type":"ContainerStarted","Data":"86ee2d6d058af54b2988da8dac50da8b0c51c3da5e6c0b152637c407adbfcf32"} Jun 08 15:47:44.903969 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:44.903932 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" event={"ID":"29e25473-1c92-42ff-b28c-be893332f5e1","Type":"ContainerStarted","Data":"47080b22cabc6a2e7ac9757fd713f2d1f5711fd5da713e813cb81f3010fc2f83"} Jun 08 15:47:44.904322 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:44.904061 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:47:44.925603 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:44.925558 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" podStartSLOduration=1.38242494 podStartE2EDuration="3.92554211s" totalImagesPullingTime="2.54311717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:47:44.923210546 +0000 UTC m=+837.863661842" watchObservedRunningTime="2026-06-08 15:47:44.92554211 +0000 UTC m=+837.865993453" Jun 08 15:47:55.910710 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:47:55.910681 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kwm8q" Jun 08 15:48:47.535398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:48:47.535325 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:48:47.536002 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:48:47.535981 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:49:45.145908 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:49:45.145871 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:50:40.933043 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.933006 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp"] Jun 08 15:50:40.935987 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.935964 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:40.939190 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.939170 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 15:50:40.940473 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.940454 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ngk5s\"" Jun 08 15:50:40.940536 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.940480 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 15:50:40.940591 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.940565 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 15:50:40.946903 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:40.946881 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp"] Jun 08 15:50:41.059828 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059794 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6flz\" (UniqueName: \"kubernetes.io/projected/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kube-api-access-d6flz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.060009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059864 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.060009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059910 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.060009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.060009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.060009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.059989 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160785 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160746 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160795 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160814 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.160978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.160910 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6flz\" (UniqueName: \"kubernetes.io/projected/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kube-api-access-d6flz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.161255 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.161229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.161398 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.161371 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.161525 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.161441 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.163332 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.163303 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.163532 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.163517 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.169020 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.168995 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6flz\" (UniqueName: \"kubernetes.io/projected/fc81bdda-dc18-4e5b-a31c-9ac682d17be1-kube-api-access-d6flz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp\" (UID: \"fc81bdda-dc18-4e5b-a31c-9ac682d17be1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.248069 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.247998 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:41.378924 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.378896 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp"] Jun 08 15:50:41.380425 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:50:41.380385 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc81bdda_dc18_4e5b_a31c_9ac682d17be1.slice/crio-877bc35e7679cd49c0a9fc71bf09fc597d4a2e0fb57b5d13b4af27066d0308f8 WatchSource:0}: Error finding container 877bc35e7679cd49c0a9fc71bf09fc597d4a2e0fb57b5d13b4af27066d0308f8: Status 404 returned error can't find the container with id 877bc35e7679cd49c0a9fc71bf09fc597d4a2e0fb57b5d13b4af27066d0308f8 Jun 08 15:50:41.382419 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.382403 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 15:50:41.505301 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.505211 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:50:41.779179 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:41.779148 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" event={"ID":"fc81bdda-dc18-4e5b-a31c-9ac682d17be1","Type":"ContainerStarted","Data":"877bc35e7679cd49c0a9fc71bf09fc597d4a2e0fb57b5d13b4af27066d0308f8"} Jun 08 15:50:45.809542 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:45.809506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" event={"ID":"fc81bdda-dc18-4e5b-a31c-9ac682d17be1","Type":"ContainerStarted","Data":"a85995bb91fc0ad1eea976f911f05917a0f84a1ea81f90e4217a6d2300a53dfa"} Jun 08 15:50:47.820689 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:47.820658 2553 generic.go:356] "Generic (PLEG): container finished" podID="fc81bdda-dc18-4e5b-a31c-9ac682d17be1" containerID="a85995bb91fc0ad1eea976f911f05917a0f84a1ea81f90e4217a6d2300a53dfa" exitCode=0 Jun 08 15:50:47.821128 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:47.820706 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" event={"ID":"fc81bdda-dc18-4e5b-a31c-9ac682d17be1","Type":"ContainerDied","Data":"a85995bb91fc0ad1eea976f911f05917a0f84a1ea81f90e4217a6d2300a53dfa"} Jun 08 15:50:49.706077 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.706046 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv"] Jun 08 15:50:49.708921 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.708898 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.711615 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.711571 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 15:50:49.718376 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.718352 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv"] Jun 08 15:50:49.834535 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.834496 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" event={"ID":"fc81bdda-dc18-4e5b-a31c-9ac682d17be1","Type":"ContainerStarted","Data":"69f59581072340adb4a7b6a463ae3d1f6f994d21e1402b1ac56a88161663ff61"} Jun 08 15:50:49.843248 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843219 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.843418 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843265 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.843418 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.843418 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843354 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.843418 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzsjw\" (UniqueName: \"kubernetes.io/projected/5bc582db-a174-4e98-bf1a-fc0d2999923b-kube-api-access-fzsjw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.843619 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.843458 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc582db-a174-4e98-bf1a-fc0d2999923b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.854056 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.854015 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" podStartSLOduration=3.041182682 podStartE2EDuration="9.853999065s" totalImagesPullingTime="5.531402143s" totalInitContainerRuntime="1.28141424s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:50:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:50:49.851856723 +0000 UTC m=+1022.792308019" watchObservedRunningTime="2026-06-08 15:50:49.853999065 +0000 UTC m=+1022.794450361" Jun 08 15:50:49.944023 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.943985 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944093 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944128 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzsjw\" (UniqueName: \"kubernetes.io/projected/5bc582db-a174-4e98-bf1a-fc0d2999923b-kube-api-access-fzsjw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944226 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944181 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc582db-a174-4e98-bf1a-fc0d2999923b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944760 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944738 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944853 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944788 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.944915 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.944841 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.946656 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.946634 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc582db-a174-4e98-bf1a-fc0d2999923b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.946980 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.946963 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc582db-a174-4e98-bf1a-fc0d2999923b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:49.952506 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:49.952483 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzsjw\" (UniqueName: \"kubernetes.io/projected/5bc582db-a174-4e98-bf1a-fc0d2999923b-kube-api-access-fzsjw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rqcvv\" (UID: \"5bc582db-a174-4e98-bf1a-fc0d2999923b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:50.020939 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:50.020906 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:50:50.103695 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:50.103659 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:50:50.151588 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:50.151566 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv"] Jun 08 15:50:50.154254 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:50:50.154227 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc582db_a174_4e98_bf1a_fc0d2999923b.slice/crio-f676d5580bb326462e6d1ae09a9f04ee5f23693b6a3e190c60705703e52eb36c WatchSource:0}: Error finding container f676d5580bb326462e6d1ae09a9f04ee5f23693b6a3e190c60705703e52eb36c: Status 404 returned error can't find the container with id f676d5580bb326462e6d1ae09a9f04ee5f23693b6a3e190c60705703e52eb36c Jun 08 15:50:50.841442 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:50.841408 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" event={"ID":"5bc582db-a174-4e98-bf1a-fc0d2999923b","Type":"ContainerStarted","Data":"88ebfcbb45053a66cfd6626940e403df6291f5ace405a86f0a66de4852b5c8f9"} Jun 08 15:50:50.841844 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:50.841462 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" event={"ID":"5bc582db-a174-4e98-bf1a-fc0d2999923b","Type":"ContainerStarted","Data":"f676d5580bb326462e6d1ae09a9f04ee5f23693b6a3e190c60705703e52eb36c"} Jun 08 15:50:51.249023 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:51.248935 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:51.249176 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:51.249040 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:51.261570 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:51.261545 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:51.860042 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:51.860010 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp" Jun 08 15:50:57.879683 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:57.879647 2553 generic.go:356] "Generic (PLEG): container finished" podID="5bc582db-a174-4e98-bf1a-fc0d2999923b" containerID="88ebfcbb45053a66cfd6626940e403df6291f5ace405a86f0a66de4852b5c8f9" exitCode=0 Jun 08 15:50:57.880123 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:57.879718 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" event={"ID":"5bc582db-a174-4e98-bf1a-fc0d2999923b","Type":"ContainerDied","Data":"88ebfcbb45053a66cfd6626940e403df6291f5ace405a86f0a66de4852b5c8f9"} Jun 08 15:50:58.886551 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:58.886515 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" event={"ID":"5bc582db-a174-4e98-bf1a-fc0d2999923b","Type":"ContainerStarted","Data":"ee8d4690a1d380b90b81bba6f6d9147d2bd3e465f9c399b89ecb05e9aaabdfe6"} Jun 08 15:50:58.905318 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:50:58.905240 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" podStartSLOduration=2.819604577 podStartE2EDuration="9.905225023s" totalImagesPullingTime="250.997244ms" totalInitContainerRuntime="6.834623202s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:50:58.904664009 +0000 UTC m=+1031.845115305" watchObservedRunningTime="2026-06-08 15:50:58.905225023 +0000 UTC m=+1031.845676631" Jun 08 15:51:00.021525 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:00.021471 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:51:00.021977 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:00.021553 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:51:00.034029 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:00.034005 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:51:00.908100 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:00.908076 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rqcvv" Jun 08 15:51:07.822551 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.822521 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq"] Jun 08 15:51:07.824925 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.824909 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.827734 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.827711 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 15:51:07.834854 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.834831 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq"] Jun 08 15:51:07.901870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.901830 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.901870 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.901877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.902094 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.901947 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.902094 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.901975 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.902094 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.902050 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:07.902208 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:07.902103 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvdjc\" (UniqueName: \"kubernetes.io/projected/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kube-api-access-dvdjc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003342 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003377 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003643 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003417 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003643 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003643 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003643 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003502 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvdjc\" (UniqueName: \"kubernetes.io/projected/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kube-api-access-dvdjc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003864 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003785 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003864 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003844 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.003944 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.003920 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.005732 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.005713 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.005988 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.005971 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.011726 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.011703 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvdjc\" (UniqueName: \"kubernetes.io/projected/c3aa89ae-212a-4fc8-8cfe-4aba481e4b36-kube-api-access-dvdjc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq\" (UID: \"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.136065 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.135967 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:08.275424 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.275396 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq"] Jun 08 15:51:08.277073 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:51:08.277038 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3aa89ae_212a_4fc8_8cfe_4aba481e4b36.slice/crio-adbde0d4425d1890d7887b3d6e0dbbba8cb56b54b7198ce547373f82971063fb WatchSource:0}: Error finding container adbde0d4425d1890d7887b3d6e0dbbba8cb56b54b7198ce547373f82971063fb: Status 404 returned error can't find the container with id adbde0d4425d1890d7887b3d6e0dbbba8cb56b54b7198ce547373f82971063fb Jun 08 15:51:08.512271 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.512184 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:51:08.939229 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.939196 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" event={"ID":"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36","Type":"ContainerStarted","Data":"0d1c139acf36f1f498c3e45c3e45fe5559e3bc2fbc3a762e1cf55892e9cf78ee"} Jun 08 15:51:08.939624 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:08.939278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" event={"ID":"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36","Type":"ContainerStarted","Data":"adbde0d4425d1890d7887b3d6e0dbbba8cb56b54b7198ce547373f82971063fb"} Jun 08 15:51:09.945872 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:09.945781 2553 generic.go:356] "Generic (PLEG): container finished" podID="c3aa89ae-212a-4fc8-8cfe-4aba481e4b36" containerID="0d1c139acf36f1f498c3e45c3e45fe5559e3bc2fbc3a762e1cf55892e9cf78ee" exitCode=0 Jun 08 15:51:09.946230 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:09.945868 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" event={"ID":"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36","Type":"ContainerDied","Data":"0d1c139acf36f1f498c3e45c3e45fe5559e3bc2fbc3a762e1cf55892e9cf78ee"} Jun 08 15:51:10.953875 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:10.953837 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" event={"ID":"c3aa89ae-212a-4fc8-8cfe-4aba481e4b36","Type":"ContainerStarted","Data":"aabcdb0d8e0ad03bc0b37a51c5fa33e3e8ef5b130e65ea160279e78dfb64619d"} Jun 08 15:51:10.971636 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:10.971567 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" podStartSLOduration=2.389415078 podStartE2EDuration="3.971552411s" totalImagesPullingTime="248.921972ms" totalInitContainerRuntime="1.333215361s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:51:10.970901213 +0000 UTC m=+1043.911352522" watchObservedRunningTime="2026-06-08 15:51:10.971552411 +0000 UTC m=+1043.912003755" Jun 08 15:51:13.010948 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:13.010916 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:51:16.401691 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.401652 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m"] Jun 08 15:51:16.405940 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.405917 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.409064 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.409041 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 15:51:16.414432 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.414367 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m"] Jun 08 15:51:16.587529 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587490 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.587720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z28tl\" (UniqueName: \"kubernetes.io/projected/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kube-api-access-z28tl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.587720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587646 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.587720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587685 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5697f36-fb22-4da1-bf4a-abf6b61d997e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.587720 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587705 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.587888 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.587755 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.688859 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.688787 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.688859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z28tl\" (UniqueName: \"kubernetes.io/projected/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kube-api-access-z28tl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.688906 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.688953 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5697f36-fb22-4da1-bf4a-abf6b61d997e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689009 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.688983 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689220 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.689033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689290 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.689259 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689364 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.689345 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.689528 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.689508 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.691231 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.691211 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5697f36-fb22-4da1-bf4a-abf6b61d997e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.691504 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.691484 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5697f36-fb22-4da1-bf4a-abf6b61d997e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.696954 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.696927 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z28tl\" (UniqueName: \"kubernetes.io/projected/d5697f36-fb22-4da1-bf4a-abf6b61d997e-kube-api-access-z28tl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m\" (UID: \"d5697f36-fb22-4da1-bf4a-abf6b61d997e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.717508 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.717483 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:16.849912 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.849873 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m"] Jun 08 15:51:16.851447 ip-10-0-141-19 kubenswrapper[2553]: W0608 15:51:16.851413 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5697f36_fb22_4da1_bf4a_abf6b61d997e.slice/crio-8ec4e504229853ed66d12efdf890cea26e6868e8f4e2771014ce8e957b1f192c WatchSource:0}: Error finding container 8ec4e504229853ed66d12efdf890cea26e6868e8f4e2771014ce8e957b1f192c: Status 404 returned error can't find the container with id 8ec4e504229853ed66d12efdf890cea26e6868e8f4e2771014ce8e957b1f192c Jun 08 15:51:16.993865 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.993770 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" event={"ID":"d5697f36-fb22-4da1-bf4a-abf6b61d997e","Type":"ContainerStarted","Data":"5cbcedb11f6e21170e98607a01a75e5547e99fd56e23215494630f556f79ef3d"} Jun 08 15:51:16.993865 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:16.993843 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" event={"ID":"d5697f36-fb22-4da1-bf4a-abf6b61d997e","Type":"ContainerStarted","Data":"8ec4e504229853ed66d12efdf890cea26e6868e8f4e2771014ce8e957b1f192c"} Jun 08 15:51:17.415643 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:17.415612 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:51:18.136260 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:18.136227 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:18.136571 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:18.136294 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:18.148845 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:18.148820 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:19.015213 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:19.015185 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq" Jun 08 15:51:20.288575 ip-10-0-141-19 kubenswrapper[2553]: E0608 15:51:20.288539 2553 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5697f36_fb22_4da1_bf4a_abf6b61d997e.slice/crio-conmon-5cbcedb11f6e21170e98607a01a75e5547e99fd56e23215494630f556f79ef3d.scope\": RecentStats: unable to find data in memory cache]" Jun 08 15:51:21.015551 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:21.015515 2553 generic.go:356] "Generic (PLEG): container finished" podID="d5697f36-fb22-4da1-bf4a-abf6b61d997e" containerID="5cbcedb11f6e21170e98607a01a75e5547e99fd56e23215494630f556f79ef3d" exitCode=0 Jun 08 15:51:21.015757 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:21.015587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" event={"ID":"d5697f36-fb22-4da1-bf4a-abf6b61d997e","Type":"ContainerDied","Data":"5cbcedb11f6e21170e98607a01a75e5547e99fd56e23215494630f556f79ef3d"} Jun 08 15:51:22.022550 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:22.022512 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" event={"ID":"d5697f36-fb22-4da1-bf4a-abf6b61d997e","Type":"ContainerStarted","Data":"890327dfc02ba34509b74d91ea9f9fb98b2e3b725e71b5a524211bf6ba0428db"} Jun 08 15:51:22.041431 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:22.041389 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" podStartSLOduration=2.514616041 podStartE2EDuration="6.041374673s" totalImagesPullingTime="208.444151ms" totalInitContainerRuntime="3.318314481s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:51:22.040348513 +0000 UTC m=+1054.980799820" watchObservedRunningTime="2026-06-08 15:51:22.041374673 +0000 UTC m=+1054.981825969" Jun 08 15:51:22.714742 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:22.714703 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:51:26.717931 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:26.717892 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:26.718317 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:26.717962 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:26.730335 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:26.730308 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:51:27.062314 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:51:27.062285 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m" Jun 08 15:52:26.909978 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:52:26.909942 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:52:30.114033 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:52:30.113993 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:52:38.019949 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:52:38.019915 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:52:48.516407 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:52:48.516364 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:52:57.512258 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:52:57.512216 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:53:07.916687 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:07.916607 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:53:16.712208 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:16.712172 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:53:27.313122 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:27.313085 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:53:47.569960 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:47.569926 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:53:47.572099 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:47.572079 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:53:59.209447 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:53:59.209412 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:54:02.510341 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:54:02.510305 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:54:11.118845 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:54:11.118806 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:54:13.909470 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:54:13.909427 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:54:42.011676 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:54:42.011580 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:54:57.815012 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:54:57.814968 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:55:36.306671 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:55:36.306637 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:55:53.207143 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:55:53.207103 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:56:07.512368 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:56:07.512287 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:56:22.613490 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:56:22.613457 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:56:25.608435 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:56:25.608398 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:57:04.205899 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:57:04.205863 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:57:07.305933 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:57:07.305902 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:57:29.508722 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:57:29.508683 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:57:38.408421 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:57:38.408338 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:57:55.205427 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:57:55.205389 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:58:03.711556 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:58:03.711519 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:58:21.111977 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:58:21.111941 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:58:29.412776 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:58:29.412740 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:58:47.602878 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:58:47.602850 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:58:47.607378 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:58:47.607355 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 15:59:02.010339 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:02.010248 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:11.207523 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:11.207485 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:19.601959 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:19.601923 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:27.409646 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:27.409608 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:35.707360 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:35.707324 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:43.909029 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:43.908988 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:46.911628 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:46.911582 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 15:59:52.813586 ip-10-0-141-19 kubenswrapper[2553]: I0608 15:59:52.813548 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:00:04.312294 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:00:04.312253 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:00:41.605317 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:00:41.605231 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:00:43.705697 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:00:43.705662 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:00:50.811462 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:00:50.811424 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:00:53.917128 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:00:53.917091 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:02.611531 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:02.611493 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:10.908963 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:10.908931 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:20.108986 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:20.108945 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:29.307016 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:29.306975 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:38.005813 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:38.005778 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:41.807073 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:41.807037 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:46.414896 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:46.414857 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:01:55.109727 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:01:55.109688 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:04.207092 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:04.206998 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:13.014571 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:13.014529 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:21.910035 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:21.909993 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:30.506444 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:30.506409 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:39.401703 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:39.401663 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:47.609205 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:47.609167 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:02:55.710662 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:02:55.710620 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:03:06.110450 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:03:06.110402 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:03:13.904280 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:03:13.904245 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:03:47.635382 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:03:47.635357 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:03:47.642005 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:03:47.641984 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:04:05.959333 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:05.959295 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 16:04:05.960064 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:05.959520 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" podUID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" containerName="manager" containerID="cri-o://5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02" gracePeriod=10 Jun 08 16:04:06.218305 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.218250 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 16:04:06.300622 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.300572 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume\") pod \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " Jun 08 16:04:06.300801 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.300629 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtz7q\" (UniqueName: \"kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q\") pod \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\" (UID: \"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6\") " Jun 08 16:04:06.300943 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.300918 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" (UID: "5deed1db-b329-47df-9bc7-3cbaf2c5f4c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:04:06.302633 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.302582 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q" (OuterVolumeSpecName: "kube-api-access-jtz7q") pod "5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" (UID: "5deed1db-b329-47df-9bc7-3cbaf2c5f4c6"). InnerVolumeSpecName "kube-api-access-jtz7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:04:06.401296 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.401264 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-extensions-socket-volume\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 16:04:06.401296 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:06.401290 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtz7q\" (UniqueName: \"kubernetes.io/projected/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6-kube-api-access-jtz7q\") on node \"ip-10-0-141-19.ec2.internal\" DevicePath \"\"" Jun 08 16:04:07.071427 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.071388 2553 generic.go:356] "Generic (PLEG): container finished" podID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" containerID="5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02" exitCode=0 Jun 08 16:04:07.071427 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.071428 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" Jun 08 16:04:07.072013 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.071445 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" event={"ID":"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6","Type":"ContainerDied","Data":"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02"} Jun 08 16:04:07.072013 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.071494 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g" event={"ID":"5deed1db-b329-47df-9bc7-3cbaf2c5f4c6","Type":"ContainerDied","Data":"37dffa3e5cb007082a605375fa30f5aa7288b1f6963cc99b166be9de29c395b5"} Jun 08 16:04:07.072013 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.071518 2553 scope.go:117] "RemoveContainer" containerID="5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02" Jun 08 16:04:07.081586 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.081567 2553 scope.go:117] "RemoveContainer" containerID="5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02" Jun 08 16:04:07.081941 ip-10-0-141-19 kubenswrapper[2553]: E0608 16:04:07.081918 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02\": container with ID starting with 5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02 not found: ID does not exist" containerID="5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02" Jun 08 16:04:07.082019 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.081950 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02"} err="failed to get container status \"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02\": rpc error: code = NotFound desc = could not find container \"5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02\": container with ID starting with 5b98bf78d2dca2a670876f783bc793c713f858163586848bb6d55f2efcf92b02 not found: ID does not exist" Jun 08 16:04:07.096517 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.096493 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 16:04:07.099901 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.099876 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-llw9g"] Jun 08 16:04:07.525069 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:04:07.525033 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" path="/var/lib/kubelet/pods/5deed1db-b329-47df-9bc7-3cbaf2c5f4c6/volumes" Jun 08 16:05:12.145268 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.145186 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg"] Jun 08 16:05:12.145711 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.145549 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" containerName="manager" Jun 08 16:05:12.145711 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.145562 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" containerName="manager" Jun 08 16:05:12.145711 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.145650 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5deed1db-b329-47df-9bc7-3cbaf2c5f4c6" containerName="manager" Jun 08 16:05:12.148569 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.148554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.155047 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.155025 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v2p9l\"" Jun 08 16:05:12.162788 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.162753 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg"] Jun 08 16:05:12.296195 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.296149 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn2bx\" (UniqueName: \"kubernetes.io/projected/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-kube-api-access-tn2bx\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.296195 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.296211 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.396933 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.396846 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn2bx\" (UniqueName: \"kubernetes.io/projected/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-kube-api-access-tn2bx\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.396933 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.396903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.397232 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.397216 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.406234 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.406201 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn2bx\" (UniqueName: \"kubernetes.io/projected/b5ef13ab-41b3-47ac-af5c-ac66526c8fce-kube-api-access-tn2bx\") pod \"kuadrant-operator-controller-manager-86878c769f-6jtzg\" (UID: \"b5ef13ab-41b3-47ac-af5c-ac66526c8fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.458239 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.458215 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:12.593635 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:12.593607 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg"] Jun 08 16:05:12.595216 ip-10-0-141-19 kubenswrapper[2553]: W0608 16:05:12.595189 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ef13ab_41b3_47ac_af5c_ac66526c8fce.slice/crio-367a90f236740edb8099758779227f321b11d1a619478f645967dec41f6b5591 WatchSource:0}: Error finding container 367a90f236740edb8099758779227f321b11d1a619478f645967dec41f6b5591: Status 404 returned error can't find the container with id 367a90f236740edb8099758779227f321b11d1a619478f645967dec41f6b5591 Jun 08 16:05:13.425182 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:13.425147 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" event={"ID":"b5ef13ab-41b3-47ac-af5c-ac66526c8fce","Type":"ContainerStarted","Data":"41c1735cca873d490e235e59d609d611c6e4ccd926de2f7b70745a559d651125"} Jun 08 16:05:13.425645 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:13.425227 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" event={"ID":"b5ef13ab-41b3-47ac-af5c-ac66526c8fce","Type":"ContainerStarted","Data":"367a90f236740edb8099758779227f321b11d1a619478f645967dec41f6b5591"} Jun 08 16:05:13.425645 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:13.425360 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:13.448280 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:13.448233 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" podStartSLOduration=1.4482202339999999 podStartE2EDuration="1.448220234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:05:13.444281301 +0000 UTC m=+1886.384732631" watchObservedRunningTime="2026-06-08 16:05:13.448220234 +0000 UTC m=+1886.388671530" Jun 08 16:05:24.432950 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:24.432913 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6jtzg" Jun 08 16:05:31.427783 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:31.427746 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:05:36.705305 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:05:36.705269 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:03.419155 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:03.419117 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:07.707358 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:07.707320 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:17.525454 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:17.525422 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:28.212112 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:28.212077 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:36.915252 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:36.915169 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:47.304562 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:47.304523 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:06:56.609741 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:06:56.609704 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:07:06.206839 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:07:06.206797 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:07:15.705329 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:07:15.705293 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:07:25.509956 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:07:25.509919 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:07:34.704689 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:07:34.704652 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:07:38.538226 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:07:38.538188 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:08:07.526349 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:08:07.526274 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:08:47.675338 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:08:47.675312 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:08:47.681393 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:08:47.681371 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:08:51.110369 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:08:51.110336 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:08:59.507910 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:08:59.507866 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:08.705219 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:08.705183 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:16.410344 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:16.410307 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:26.209531 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:26.209498 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:35.813497 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:35.813419 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:46.011331 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:46.011294 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:09:52.211844 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:09:52.211809 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:01.717953 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:01.717914 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:10.006106 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:10.006067 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:17.704542 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:17.704506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:28.108352 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:28.108318 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:46.514067 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:46.514025 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:10:54.510448 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:10:54.510416 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:03.808096 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:03.808010 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:11.803934 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:11.803889 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:29.311013 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:29.310972 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:37.511007 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:37.510971 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:46.510258 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:46.510224 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:11:54.514966 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:11:54.514934 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:04.209005 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:04.208965 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:11.810549 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:11.810513 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:22.008424 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:22.008372 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:34.102512 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:34.102429 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:44.410710 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:44.410672 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:12:56.408065 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:12:56.408028 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:06.706617 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:06.706560 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:13.111231 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:13.111193 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:23.308075 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:23.308039 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:29.610392 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:29.610353 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:46.308514 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:46.308476 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:13:47.716509 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:47.716485 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:13:47.723822 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:47.723802 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:13:54.914981 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:13:54.914943 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:14:03.810918 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:14:03.810834 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:14:09.708873 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:14:09.708837 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:14:33.311389 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:14:33.311355 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:14:46.710332 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:14:46.710295 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kwm8q"] Jun 08 16:15:23.506777 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:23.506750 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b4d846984-q5kcj_ae947b5b-c717-4d05-96c9-89e0c6288001/nginx/0.log" Jun 08 16:15:23.734452 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:23.734428 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4bjf7_eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab/manager/0.log" Jun 08 16:15:23.855421 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:23.855392 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8thf4_31b2f637-b8cc-4630-863e-f853575e87b6/manager/0.log" Jun 08 16:15:24.093780 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:24.093753 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-klchf_01ed415a-6076-4403-abec-108307175465/server/0.log" Jun 08 16:15:24.216525 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:24.216444 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rvjwj_890d7cac-6e7e-4856-a924-055264362ac0/manager/0.log" Jun 08 16:15:24.349454 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:24.349417 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6484fb6dbf-4pkzw_dc609bec-cf18-4258-a302-adea168ab501/manager/0.log" Jun 08 16:15:24.364178 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:24.364154 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6484fb6dbf-4pkzw_dc609bec-cf18-4258-a302-adea168ab501/copy-manifests/0.log" Jun 08 16:15:26.140684 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:26.140652 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p92gn_219025da-b6ce-4610-92b9-e748618d1e7a/manager/0.log" Jun 08 16:15:26.501840 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:26.501761 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6jtzg_b5ef13ab-41b3-47ac-af5c-ac66526c8fce/manager/0.log" Jun 08 16:15:26.620954 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:26.616028 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kwm8q_29e25473-1c92-42ff-b28c-be893332f5e1/limitador/0.log" Jun 08 16:15:27.195871 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:27.195840 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nmcnf_c2e742b3-3a25-4df4-a488-c4c886fcab2c/discovery/0.log" Jun 08 16:15:27.426550 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:27.426520 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74547644b9-p4rqr_333dbc83-4405-4c9c-957d-87bff245e370/kube-auth-proxy/0.log" Jun 08 16:15:28.223392 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.223361 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp_fc81bdda-dc18-4e5b-a31c-9ac682d17be1/storage-initializer/0.log" Jun 08 16:15:28.230718 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.230689 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-c4fdp_fc81bdda-dc18-4e5b-a31c-9ac682d17be1/main/0.log" Jun 08 16:15:28.338377 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.338345 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rqcvv_5bc582db-a174-4e98-bf1a-fc0d2999923b/storage-initializer/0.log" Jun 08 16:15:28.346703 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.346674 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rqcvv_5bc582db-a174-4e98-bf1a-fc0d2999923b/main/0.log" Jun 08 16:15:28.452982 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.452955 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq_c3aa89ae-212a-4fc8-8cfe-4aba481e4b36/storage-initializer/0.log" Jun 08 16:15:28.460553 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.460528 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7q8dq_c3aa89ae-212a-4fc8-8cfe-4aba481e4b36/main/0.log" Jun 08 16:15:28.697249 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.697221 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m_d5697f36-fb22-4da1-bf4a-abf6b61d997e/storage-initializer/0.log" Jun 08 16:15:28.705478 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:28.705451 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-t9m2m_d5697f36-fb22-4da1-bf4a-abf6b61d997e/main/0.log" Jun 08 16:15:35.756414 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:35.756325 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p8zzs_2ea0fbd1-bc8c-4c89-a626-b1cbb0858764/global-pull-secret-syncer/0.log" Jun 08 16:15:35.901419 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:35.901387 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mqkgg_54e5e317-494c-40dc-b863-7d6e18955ef7/konnectivity-agent/0.log" Jun 08 16:15:35.941761 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:35.941733 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-19.ec2.internal_9338fa01d9ee5659f0df90fbdc92c33e/haproxy/0.log" Jun 08 16:15:40.292553 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:40.292505 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-nlgdt_4ac96ba5-16f7-488c-897b-d937ec0764c5/sail-operator/0.log" Jun 08 16:15:40.500800 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:40.500771 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p92gn_219025da-b6ce-4610-92b9-e748618d1e7a/manager/0.log" Jun 08 16:15:40.671338 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:40.671252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6jtzg_b5ef13ab-41b3-47ac-af5c-ac66526c8fce/manager/0.log" Jun 08 16:15:40.691326 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:40.691299 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kwm8q_29e25473-1c92-42ff-b28c-be893332f5e1/limitador/0.log" Jun 08 16:15:42.498423 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.498385 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/alertmanager/0.log" Jun 08 16:15:42.520061 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.519984 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/config-reloader/0.log" Jun 08 16:15:42.538706 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.538684 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/kube-rbac-proxy-web/0.log" Jun 08 16:15:42.560136 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.560100 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/kube-rbac-proxy/0.log" Jun 08 16:15:42.578948 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.578924 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/kube-rbac-proxy-metric/0.log" Jun 08 16:15:42.597567 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.597546 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/prom-label-proxy/0.log" Jun 08 16:15:42.618268 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.618248 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f4abe462-1e03-4d20-858c-c4670f7357ba/init-config-reloader/0.log" Jun 08 16:15:42.971482 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.971457 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfb5t_ba7851d1-3446-4601-a10f-81d54c0419d6/node-exporter/0.log" Jun 08 16:15:42.987782 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:42.987762 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfb5t_ba7851d1-3446-4601-a10f-81d54c0419d6/kube-rbac-proxy/0.log" Jun 08 16:15:43.008786 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:43.008763 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qfb5t_ba7851d1-3446-4601-a10f-81d54c0419d6/init-textfile/0.log" Jun 08 16:15:43.348880 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:43.348827 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-644b997c57-c6mtb_4560d8f3-c6ce-477a-aaff-4c544734ccab/telemeter-client/0.log" Jun 08 16:15:43.370798 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:43.370773 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-644b997c57-c6mtb_4560d8f3-c6ce-477a-aaff-4c544734ccab/reload/0.log" Jun 08 16:15:43.398880 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:43.398860 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-644b997c57-c6mtb_4560d8f3-c6ce-477a-aaff-4c544734ccab/kube-rbac-proxy/0.log" Jun 08 16:15:46.285118 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:46.285085 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f5df5b6c9-q466b_00f54810-adc3-4745-85b6-2b66c792c165/console/0.log" Jun 08 16:15:46.318706 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:46.318676 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-dtfkl_b54a3050-8610-428d-9a65-0ed06ac78f14/download-server/0.log" Jun 08 16:15:48.260075 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.260043 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-prmb9_ab8cacf2-eea4-4fe1-8799-8ca1a4761d68/dns/0.log" Jun 08 16:15:48.280854 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.280822 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-prmb9_ab8cacf2-eea4-4fe1-8799-8ca1a4761d68/kube-rbac-proxy/0.log" Jun 08 16:15:48.380650 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.380590 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf"] Jun 08 16:15:48.386194 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.386165 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.386519 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.386481 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fs5kd_1b1c1d85-f60d-4475-b546-3b3ab361404a/dns-node-resolver/0.log" Jun 08 16:15:48.389647 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.389621 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxtpw\"/\"kube-root-ca.crt\"" Jun 08 16:15:48.390891 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.390866 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxtpw\"/\"openshift-service-ca.crt\"" Jun 08 16:15:48.390891 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.390982 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pxtpw\"/\"default-dockercfg-mgwbq\"" Jun 08 16:15:48.392319 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.392295 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf"] Jun 08 16:15:48.475320 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.475286 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-proc\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.475320 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.475320 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsc6\" (UniqueName: \"kubernetes.io/projected/0584ebff-132e-4f18-b874-5f8bce11bb5d-kube-api-access-5lsc6\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.475510 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.475380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-lib-modules\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.475510 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.475415 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-sys\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.475510 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.475488 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-podres\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576770 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-lib-modules\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576784 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-sys\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-podres\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576900 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-proc\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576916 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-lib-modules\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576925 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsc6\" (UniqueName: \"kubernetes.io/projected/0584ebff-132e-4f18-b874-5f8bce11bb5d-kube-api-access-5lsc6\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.576938 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.576931 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-sys\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.577130 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.577058 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-podres\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.577130 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.577061 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0584ebff-132e-4f18-b874-5f8bce11bb5d-proc\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.585046 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.585021 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsc6\" (UniqueName: \"kubernetes.io/projected/0584ebff-132e-4f18-b874-5f8bce11bb5d-kube-api-access-5lsc6\") pod \"perf-node-gather-daemonset-rqpkf\" (UID: \"0584ebff-132e-4f18-b874-5f8bce11bb5d\") " pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.697653 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.697615 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:48.827373 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:48.827349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf"] Jun 08 16:15:48.829145 ip-10-0-141-19 kubenswrapper[2553]: W0608 16:15:48.829116 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0584ebff_132e_4f18_b874_5f8bce11bb5d.slice/crio-3af1448b2d2e6dbe4eb75b54aaad3e41e36eafd2942fb75ae58b38dcbc3f141d WatchSource:0}: Error finding container 3af1448b2d2e6dbe4eb75b54aaad3e41e36eafd2942fb75ae58b38dcbc3f141d: Status 404 returned error can't find the container with id 3af1448b2d2e6dbe4eb75b54aaad3e41e36eafd2942fb75ae58b38dcbc3f141d Jun 08 16:15:49.104079 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:49.103999 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vw2z_a6c46255-6957-451e-be9c-5d45a0614ecd/node-ca/0.log" Jun 08 16:15:49.824073 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:49.824036 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" event={"ID":"0584ebff-132e-4f18-b874-5f8bce11bb5d","Type":"ContainerStarted","Data":"80ba287c53be9e92e5f7069df27f16944e41242caa1daf06975438ab1994f99c"} Jun 08 16:15:49.824451 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:49.824090 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" event={"ID":"0584ebff-132e-4f18-b874-5f8bce11bb5d","Type":"ContainerStarted","Data":"3af1448b2d2e6dbe4eb75b54aaad3e41e36eafd2942fb75ae58b38dcbc3f141d"} Jun 08 16:15:49.824451 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:49.824190 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:49.839524 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:49.839477 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" podStartSLOduration=1.8394584840000001 podStartE2EDuration="1.839458484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:15:49.838882584 +0000 UTC m=+2522.779333881" watchObservedRunningTime="2026-06-08 16:15:49.839458484 +0000 UTC m=+2522.779909782" Jun 08 16:15:50.165303 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:50.165220 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nmcnf_c2e742b3-3a25-4df4-a488-c4c886fcab2c/discovery/0.log" Jun 08 16:15:50.208484 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:50.208453 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74547644b9-p4rqr_333dbc83-4405-4c9c-957d-87bff245e370/kube-auth-proxy/0.log" Jun 08 16:15:51.019710 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:51.019683 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm5c4_a80a72fe-4a8c-430b-bb45-6afcafdc345d/serve-healthcheck-canary/0.log" Jun 08 16:15:51.645542 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:51.645517 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbj2w_2736b56d-8751-4f36-a7b3-bca82fe3e533/kube-rbac-proxy/0.log" Jun 08 16:15:51.665718 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:51.665690 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbj2w_2736b56d-8751-4f36-a7b3-bca82fe3e533/exporter/0.log" Jun 08 16:15:51.685123 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:51.685100 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbj2w_2736b56d-8751-4f36-a7b3-bca82fe3e533/extractor/0.log" Jun 08 16:15:53.803897 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:53.803868 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b4d846984-q5kcj_ae947b5b-c717-4d05-96c9-89e0c6288001/nginx/0.log" Jun 08 16:15:53.848915 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:53.848871 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4bjf7_eb0fb28c-2f86-43f5-93de-ebebf7ffc9ab/manager/0.log" Jun 08 16:15:53.998552 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:53.998518 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8thf4_31b2f637-b8cc-4630-863e-f853575e87b6/manager/0.log" Jun 08 16:15:54.085335 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:54.085238 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-klchf_01ed415a-6076-4403-abec-108307175465/server/0.log" Jun 08 16:15:54.159143 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:54.159110 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-rvjwj_890d7cac-6e7e-4856-a924-055264362ac0/manager/0.log" Jun 08 16:15:54.320847 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:54.320814 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6484fb6dbf-4pkzw_dc609bec-cf18-4258-a302-adea168ab501/manager/0.log" Jun 08 16:15:54.335581 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:54.335522 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6484fb6dbf-4pkzw_dc609bec-cf18-4258-a302-adea168ab501/copy-manifests/0.log" Jun 08 16:15:55.839561 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:55.839536 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pxtpw/perf-node-gather-daemonset-rqpkf" Jun 08 16:15:55.908576 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:15:55.908547 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ptv58_a27895b2-d957-43fd-8e6d-fdb996e15991/openshift-lws-operator/0.log" Jun 08 16:16:00.998382 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:00.998352 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nmcnf_c2e742b3-3a25-4df4-a488-c4c886fcab2c/discovery/0.log" Jun 08 16:16:01.031357 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:01.031325 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74547644b9-p4rqr_333dbc83-4405-4c9c-957d-87bff245e370/kube-auth-proxy/0.log" Jun 08 16:16:02.440264 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:02.440233 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nmcnf_c2e742b3-3a25-4df4-a488-c4c886fcab2c/discovery/0.log" Jun 08 16:16:02.467611 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:02.467572 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74547644b9-p4rqr_333dbc83-4405-4c9c-957d-87bff245e370/kube-auth-proxy/0.log" Jun 08 16:16:02.956449 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:02.956420 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/kube-multus-additional-cni-plugins/0.log" Jun 08 16:16:02.975208 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:02.975188 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/egress-router-binary-copy/0.log" Jun 08 16:16:02.993993 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:02.993964 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/cni-plugins/0.log" Jun 08 16:16:03.011208 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.011183 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/bond-cni-plugin/0.log" Jun 08 16:16:03.030067 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.030031 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/routeoverride-cni/0.log" Jun 08 16:16:03.047940 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.047915 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/whereabouts-cni-bincopy/0.log" Jun 08 16:16:03.068849 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.068825 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p75vr_c4fa8dcb-f8eb-4bdb-b912-69784542a05c/whereabouts-cni/0.log" Jun 08 16:16:03.276337 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.276307 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-srsrn_4d2c9345-0169-451c-afc0-a00eb1943114/kube-multus/0.log" Jun 08 16:16:03.339085 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.339060 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwcvs_fcd28f56-ce33-413d-a37b-0e447a5d1911/network-metrics-daemon/0.log" Jun 08 16:16:03.355314 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:03.355293 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lwcvs_fcd28f56-ce33-413d-a37b-0e447a5d1911/kube-rbac-proxy/0.log" Jun 08 16:16:04.267276 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.267242 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nmcnf_c2e742b3-3a25-4df4-a488-c4c886fcab2c/discovery/0.log" Jun 08 16:16:04.294494 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.294472 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74547644b9-p4rqr_333dbc83-4405-4c9c-957d-87bff245e370/kube-auth-proxy/0.log" Jun 08 16:16:04.521504 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.521406 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-controller/0.log" Jun 08 16:16:04.536097 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.536070 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/1.log" Jun 08 16:16:04.536246 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.536111 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovn-acl-logging/0.log" Jun 08 16:16:04.557626 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.557543 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/kube-rbac-proxy-node/0.log" Jun 08 16:16:04.579214 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.579184 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 16:16:04.594485 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.594464 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/northd/0.log" Jun 08 16:16:04.613004 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.612967 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/nbdb/0.log" Jun 08 16:16:04.631960 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.631930 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/sbdb/0.log" Jun 08 16:16:04.696500 ip-10-0-141-19 kubenswrapper[2553]: I0608 16:16:04.696463 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k4hv_2b8627d2-018b-4d40-b904-f4345434188c/ovnkube-controller/0.log"